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ABSTRACT 



This report describes a two-year investigation (September 1, 1965 -September 1, 
1967 )> conducted by members of the Education and Training Staffs System 
Development Corporation (SDC), into the development and use of computer- 
assisted instruction (CAl) for the in^rovement of undergraduate training in 
statistics. The target student in the study was the undergraduate social 
science major enrolled in a first course in statistical inference. 



Most of the first year was devoted to the design and implementation of an 
important software innovation called PIANIT (Programming lANg uage for* inter- 
active Teaching) consisting of a GAI author language and an associated computer 
program that has been operating within SDC's time-sharing system (TSS) since 
the summer of I966. PIANIT reduces, or completely eliminates, the CAI lesson 
author '«s need for professional programming assistance. The program has been 
operated in lesson editing, lesson presentation, and on-line calculational 
modes. The last is particularly useful for statistics instruction employing 
an expository (numerical illustration of statistical concepts) style and for 
statistical laboratory exercises. 



The second year of the study was devoted to the construction and testing of 
CAI lesson material. Four experimental lessons were constructed and presented 
with PIANIT to a total of 21 undergraduates on two California campuses (Uni- 
versity of Southern California and San Fernando Valley State College). These 
students, uslhfe campuA teletypewriters linked to TSS by DATAPHONE, each received 
between four and five hours of instruction including PIANIT communication 
procedures and conventions ( INTRO), elementary probability (PROBl), descriptive 
statistics (DESCRB), and comj^ter programming (PROGM). The field tests (and 
preparing GAI lessons used there) provided the project staff with ample oppor- 
tunities to observe both the problems euad benefits that accompany GAI. These 
observations (and Ispresslons) are discussed from the standpoint of students. 
Instructors, and lesson authors. 



It is concluded that GAI is most appropriately employed in the numerical 
demonstration of statistical concepts and for statistical laboratory exercise 
instruction. Currently (and probably for some years to come) only the more 
routine aspects of tutorial assistance c€ui be provided with GAI; however, the 
Inclusion of such assistance in expository and exercise lesson material should 
produce benefits for both students and instructors. A recommendation is made 
that PXANIT be reprogramned for less costly operation with computing equipment 
available at many colleges and universities to provide a CAI utility for these 
schools. 
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I. imODUCTION 

This final^ report for the study, ''Computer-Based Instruction in Statistical 
Inference," supported by the National Science Foundation (Grant GY-371) and 
System Development Corporation, describes a tvo-year investigation (September 1, 

1965 j to September 1, I967) into the uses of on-line computing systems for * I 

instruction in elementary statistics. The study team, members of the Education 
and Training Staff pf SDC*s Research and Develoximent Division , employed the 
Corporation's time-sharing system in their ■work. In order to create a Variety 
of instructional sequences (lessons) efficiently, a computer pro^am called 
HiANIT was developed and used to build foiar lessons which were then tested in 
campus trialLs with undergraduates. Three major parts (ll. III, iv) of this I 

report follow the introduction and provide a description of PLANIT and the , I 

lessons constructed with that program, study team impressions and observations | 

derived from the campus tests, and finally some conclusions and recommendations I 

for future development and use of this mode of statistics instruction. 

A. BACKGROUND 

Teachers of theoretical and ap>plied statistics have always recognized the value 
of including exercises requiring numerical computation on sample data in their 
students* assignments. Such VTork provides the instructor, particula:^ly in the 
elementary courses, an opportunity to assess the student's ability to compute— 
his understanding of the correspondence between sample data and the symbols in 
a calculation formula, and' most important, his ability to select and ' implement 
appropriate techniques of statistical analysis. 

Until q'uite recently, the digital computer was not employed in elementary courses 
and was used sparingly in advanced courses, primeurily for exercises that required 
significant amounts of computing. Most of this work was and is still done by 
students in the so-called statistics laboratory, equipped with desk calculators, 
with the emergence of on-line" use of computers, more convenient and immediate 
communication between student and computer became possible. Students in elemen- 
tary statistics courses at Dartmouth College are taught BASIC [ll] a programming 
language designed for use by students in mathematics and science courses, Tv/enty 
or even thirty , students may simultaneously write short programs while they are 
seated at teletypewriters linked to a central and time-shared computer. Then 
these programs may be "called" for use in numerical exercises, e.g,, in statistics, 
tics, Schatzoff [15] developed a number of programs with which advanced 
statistics students may communicate directly for complex analysis of variance 
computations, Grubb [5] did some pioneer work of a quite different sort. He 
too made use of "on-line" communication with a con^uter in statistics instruction 
but not merely for computation. He attempted to actually instruct beginning 
students in descriptive statistics via the computer. The computational aspect 
in this ^^instruction was minor; more important was Grubb's use of the computer to 
branch the student through an instructional sequence, as a function of the 
replies that the student typed in response to numerical problems in descriptive 
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statistics. The computer evaluated the student's replies, sent messages back 
(via typewriter) telling him whether or not he was correct, and then branched 
him to new or remedial work accordingly. 

One of the authors of'this report (C. H. Frye) conceived the idea of an on-line 
computer-based statistics laboratory in the summer of 1964. By the spring of 
1965 his idea was implemented in the form of a computer program called STA.T, 
operating within SDC's time-shared computer system. STAT was an attempt to 
incorporate in a sin^e program some of the computational capability afforded by 
Dartmouth's BASIC with the computer-assisted instruction (CAI) provided in Grubb's 
work. STAT provided richer CAI than the latter, however, with more computer- 
mediated assistance for the student and more complex problems for him to solve 
(inferential rather than descriptive statistics). In addition, it automated 
f^or the laboratory portion of a statistics course several functions normally 
performed by the instructor, such as providing data for problems. 

The two-year study reported here began in September I965 with an analysis of the 
resiilts gathered from student trials of STAT conducted during the spring of I965. 
The study objective was to investigate the role of CAI in supplementing the 
instruction provided in the usual first course in statistical inference for 
social science undergraduates. Because STAT provided only the laboratory exer- 
cise mode of instruction, it was not a sufficiently useful tool for investi- 
gating the computer's role in expository and tutorial modes of instruction. 

STAT was also unsatisfactory from the viewpoint of the CAI author who was not 
also an expert programmer. Any revision to STAT — and many were required follow- 
ing its trial use by students — called for the intervention of a highly sjjilled 
programmer familiar with JOVIAL, the general-purpose language used to program 
STAT. Assuming the programmer understood the nature of a requested revision 
(which was not always the case) a day or longer would elapse before STAT was 
recompiled in revised form and available for further- inspection by the author or 
for trial use by students. This delay is, of course, frustrating in the lesson- 
building stage and often intolerably if students are tightly scheduled to use 
CAI materials that require revision. One of the most important results of this 
study is a CAI system called PLANIT (^O0?amming LAHg uage for Interactive 
Reaching) which consists of an author language and a computer program for the 
preparation, editing-, and presentation of lesson material. Subsets of the lan- 
guage are sufficiently simple that they can be mastered quickly by subject- 
matter experts and teachers. The system operates interpret ively so that the 
results of the author's work are available, in the form to be seen by the student, 
within seconds after aixy portion of a lesson has been prescribed or revised. 

B. CONTENTS OF THIS REPORT 



f 




Part II of this report describes (l) the SDC Time-Sharing System (tss) in 
which PLANIT has been operating since June I966; (2) the evolution from S'lAT 
to PLANIT; (3) the PLANIT system itself; and (4) four lessons, employing all 
three instructional styles (expository, tutorial, laboratory exercise), that 
have been built using this system. 
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Part III discusses the staff's experience in preparing for and observing student 
trial use of these lessons on two California campuses— the University of 
Southern California, Los Angeles, and San Fernando Valley State College, 

Northridge . 



Part IV contains corjclusions and recommendations regarding the 
and more widespread distribution of GAI. In summary, these state that 
a valuable tool for the construction and presentation of CAI lessons employ ng 
the statistical laboratory exercise and expository (i.e., numerical demonstrat on 
of statistical concepts) modes of instruction. In order to this tool a^il- 

able to college faculties and their students, it is recommended that PIANIT be 
reprogrammed to operate with medium-small computers currently available, or soon 
to be, on many caucuses. It is- further recommended that in the interim p^iod, 
while PIANIT is being reprogrammed, a concurrent activity should be supported 
for the preparation of lesson material in statistics. 



Five appendices are included in this report; 

Appendix 1 is for those readers interested in the TSS hardware components 
used in this study. 

Appendix 2 lists the statistical subroutines (options) that are available 
in the STAT'^prograni and pjrovides an illustration of a student's work with 

STAT. 

Appendix 3 provides a rather detailed exposition of the lesson building 
and in less detail, the computational capabilities of -PIANIT. Two Notes 
at the back of this appendix describe the techniqLues used in PIANIT for 
"PHONETIC," and "FORMUIAS” matching when the student's response to a lesson 
query is compared with a stewed correct answer. 

Appendices 4 and 5 document in detail the two most complex lessons, DESCRB 
and PROGM, constructed with PIANIT. An instructor, contemplating the use 
of GAI, cannot browse through lessons such as these as he might a textbook. 
This documentation represents an initial attempt to provide examples of 
documentation that could spare the instructor many hours at the teletype- 
writer. The reader who is not interested in this problem, or the attempted 
solution wlll^find adequate lesson descriptions in the body of the report. 
Part II. 



II, PROJECT SOFTWARE PR0DUC?r3; PIANIT AND LESSONS. 

Two kinds of software were produced and tested during this two-year study. The 
first kind consists of a computer-assisted instruction (CAI) author language 
and an associated computer program; the combination is called PIANIT (Programming 
lANg uage for Interactive Teaching). PIANIT was then used to generate the second 
type of software, which consists of four CAI lessons (called INTRO, DESCRB, 

PROBl and PR0CB4), and also to present these lessons to students via teletypewriter. 
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PIANIT, was written in JOVIAL* and compiled for -execution in SDC's Time-Sharing, 
System (TSS) to operate under the control of the TSS executive program 
during its various use modes. 

This section presents a brief description of TSS and the computer program called 
STAT from which PLANIT evolved. It concludes with a description of PLANIT and 
the four CAI lessons produced thus far. 

A. THE SDG TIME-SHARIHG SYSTEM 

The SDC Time-Sharing System became operational at the Santa Monica facility in 
June, 1963, and has been in continuous use since that date. The term "time- 
sharing," as used here, means 'simultaneous access to a computer by many users 
and programs. Each program, when not active, resides in disc memory (or on 
magnetic tape) and is activated by the user when he types a LOAD command on 
his teletypewriter (TTY) or other keyboard device. The TTY may be quite remote 
from the system's computer in Santa Monica as long as it is linked by a two-way 
caonmunication channel (e.g. , DATAPHONE, TWX, leased line, etc.). As many as 
20 or 30 users may have shared access to the computer at any time. When some- 
one logs into the system (i.e., identifies himself as an authorized user) and 
then types a LOAD command, the requested program--in this case PLANIT— is 
transferred . from disc (or tape) into the computer's magnetic drum memory and 
execution of instructions in that program can begin. I^en the program is active 
In the system, it shuttles back and forth from drum to the computer's high-speed 
core memory, remaining in the latter for a few hundred milliseconds (or less) 
at a time. During these short intervals, the computer performs any outstanding 
tasks that the user may have requested via his TT3f. The requests and programs 
of all users are treated in this fashion, although at times some may be given 
priority treatment . and others may be placed in queues to await service. An 
individual user such as a student at a remote location is hardly aware that 
others are "sharing" the computer, since an average of only four or five seconds 
will elapse between the time he sends a message to the computer via the TTY and 
the time the computer replies via the same TTY. (In these few seconds, the 
computer completes a cycle of service for the other users . ) 

This "conversational" or on-line use of a computer is particularly suited to 
educational applications. The student may receive almost instantaneous feed- 
back from the computer about the correctness of the answers he submits to ques- 
tions posed by the computer. In addition, the computer can keep a record of 
the student's replies and use this "history" to determine an appropriate path 
(i.e., "branch") for the student to take through an instructional sequence;' the 
sharing aspect of computer use is of interest too, since it permits on-line 
interaction at relatively reasonable prices; the fixed costs of computer rental 
or purchase can be divided among the several computer sharing users. 

y ■ ’ f • ' , ; 

; . • 0 

* A high-level programming language and compiler developed at System Development 
Corporation. It is described in [lU]. 
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More details about SDC’s approach to time-sharing may be found in [l6] and [IT]; 
a schematic picture of the SDC system and a listing of its hardware components 
is contained in Appendix 1. A more general treatment of on-line and time- 
shared systems is available in [lo] > [13] [i8] • 

B. THE EVOLUTION FROM STAT TO PLANIT 

1. Description of STAT ><' 

It 

STAT is a computer program that has been operating within SDC's TSS since the 
fall of 1965. It provides the laboratory part of a first course in applied 
statistics— the part that teaches the student to apply the theory and technique 
discussed in the classroom and textbook. In the conventional laboratory situa- 
tion, the student is asked to work exercises consisting of some samgle data and 
a description of their origin; and he is told to use given statistical tech- 
' niques, or to select some, for population parameter estimation or statistical 
tests of hypotheses. He then performs numerical computations on the sample data 
with the aid of a desk calculator. In addition to preparing problem statements 
and generating sample data, the lab instructor or his assistant must correct 
papers, keep records of student performance, and assist the student who gets 
"stuck." STAT represents an attempt to harness computer power, on behalf of 
both students and instructors, for this instructional situation. 

Once the student types *LQAD STAT', and the TSS executive program respoMs that 
STAT has been loaded into the computer, the student begins a dialogue with a 
computer-based laboratory course in statistics. STAT is progr^ed to present 
a sequence of 25 exercises in a specific order (which can be altered). When 
STAT causes the text for .an exercise to be printed, it prints the message OPTION 
=?, on the ne:rt teletype line, to indicate to the student that he is to choose 
ft number deslgnft'tlng an option (actually a subroutine or subprogram) • If he 
types he activates the option for drawing a random sample appropriate to 

the current exercise. After the sample is generated and typed as a coltmm of 
numbers (or pairs of numbers for a bivariate or two-sample exercise), the 
message, OPTION*?, is printed. He may now choose from a variety of some 50 
remaining option, which fall into four major categories; 

. HELP 

, CALCULATION 

• LIBRARY 

. RESPONSE/EVALUATION 

* A detailed description of STAT, together with instructions for its use, is 
available in Student's Guide to STAT, TM-29IO/OOO/OO, System Development 
Corporation, March 31 > 19^6. 
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HELP options provide the slfudent with references to readings in a textbook* for 
steps leading to solution of the current exercise or for explanation of ;a 
LIBRARY option; the desperate student may even get the correct answer to that 
part of the exercise for which he has submitted an incorrect answer to STAT. 



f CALCULATION options, as the category name implies, provide the student’s 
t computing tools. The most important of these, OPTION 12, computes numerical 
values for algebraic expressions that the student types (e.g. ,"SS2/15" will 
[ yield the numerical value of the sum of squares of the data in column 2 of his 
[ sample, divided by 15). * 

I' 

I LIBRARY options operate on sample data only and are used for automatic calcula- 
tion pf sample statistics, e.g., m^ans, variances, correlations, regression 
coefficients, and various statistical test criteria or confidence intervsQ. 
limits. For example, if the student types *21', in response to 'OPTION-?', the 
value for the mean of the generated sample data will be automatically ccmputed 
I and printed. When the student uses the LIBRARY to work an exercise, there -is 
no chance for him to err, except if he chooses an inappropriate LIBRARY option. 



response/evaluation consists of a single option, OPTION 8. Here the student 
submits the answer resulting from his work for evaluation by STAT; these answers 
(usually numbers, but occasionalUy yes or no) are Judged to be correct or 
incorrect. If the latter is true,. the computer message indicating this, includes 
direction to appropriate readings in the textbook and advice to try again. 

D STAT normally present^ each exercise to the student once or twice. During the 
first presentation, the LIBRARY is available to the student. If he is able to 
supply correct answers during this first presentation without using the LIBRARY, 
he is automatically advanced to the next problem, in programmed order. If he 
does use the LIBRARY during the first presentation, STAT will present the prob- 
lem again (with different sample data). However, this time, the LIBRARY is not 
accessible and he can only use CALCULATION and HELP options to work the exercise. 
[ Thus the student is "forced" to demonstrate his ability to work each exercise, 

[ throu^out the entire sequence without assistance from the LIBRARY. 

[ Progress to a second presentation or to a new exercise is effected automatically. 

i by STAT. The student progresses in the sequence, in programmed order, only 

when he submits correct answers for the current exercises, unless he elects to 
skip to the next exercise after unsuccessful attempts to answer correctly. 

[ The student may terminate a session at. the teletypewriter by choosing OPTION 20. 

[ This provides him with a continuation code number to insert via teletype when he 
I next uses STAT; he is then automatically brou^t to an appropriate continuation 
i point in the exercise sequence. OPTION 20 also provides a performance record 



^^Hlays, W.L. Statistics for Psychologists . Holt, Rinehart and Winston^ Inc., 




* 
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for the student and/or the instructor, which indicates, for each completed 
exercise, the amount of time the student worked on the exercise, the number of 
times incorrect answers were submitted for evaluation, the number of steps to 
a solution that the student requested from STAT, and some other items. 

Appendix 2 contains some excerpts from the Student's Guide to STAT: *a complete 
list of STAT options, and the mathematical conventions employed in OPTION 12 for 
computation. A portion of a student's teletypewriter record of work with STAT 
is also included. 

2. Disadvantages of STAT *<‘ 

It became clear at the outset that the STAT program wo\ild not be sufficient for 
project requirements. First, there was a need to explore the computer's role in 
expository and in tutorial mode of instructions, whereas STAT provided only 
laboratory exercise instruction. Second, even for the latter purpose, serious 
disadvantages to STAT had been observed during student trial use of the program. 
The project staff analyzed these STAT deficiencies from the standpoint of 
students, instructors, and authors of CAI sequences. 

a. Disadvantages for the Student 

The rate at which a student can work with STAT at the TTY is unnecessarily 
slow for two main reasons. As stated earlier, the. LIBRABY options are 
available to the student only during the first presentation of each exercise. 
If he uses even one such option during the initial presentation, STAT 
requires that he work this exercise again (with different sample data) 
without LIBRARY assistance. Often the students who used STAT would demon- 
strate their mastery of peirticular statistical calculations in one exercise, 
i.e., they . obtained correct answers without using a single LIBRARY option, 
and yet they were effectively denied use of LIBRARY options for the very 
same calculcCtions in subsequent exercises (if they wished to avoid second 
presentations). Tljiese students could have worked throu^ the exercise 
sequence more quickly and with less frustration if STAT provided more 
flexible control over LIBRARY access. 

These stxidents would also have been able to work faster if they could have 
constructed mathematical functions for their own Indlvidlual use. (OPTION 
12 in STAT does provide numerical evaluation of algebraic expressions and a 
few functions of sample data arrays, e.g. , SI, the function that sums all 
the datd in column 1 of a sample may be used in these expressions.) The 



* This discussion is based on an analysis of student trials with the STAT program, 
which took place at SDC, Santa, Monica, California during the spring of 19^5 . 

Nine paid volunteers (UCZA graduate students in psychology) used STAT during 
five 3-hour teletypewriter sessions. A more detailed and complete discussion of 
the results of these trials Is available In C. Frye [k] . 
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student should also be: able to label the functions he ' defines ' and call them 
up for execution whenever (and for as long as) he needs them. In. effect, 
he would then be able to create his own library options. 






I- 




[; 

I 







There was also a need for. a richer branching capability, than STAT provided. 
If the student was able to supply correct answers, he was branched to 
another exercise presentation- If not, he was returned to the' current 
exercise for further work. No matter how many times he input an incorrect 
answer, the resulting STAT action was identical :(unlass he. gave. i^). It^ was 
clear that effective CAI would require more varied branching as a function 
of the student's "history" of responses as weU as his current response. 

. Finally, the peimlssable forms of student response were too restricted; 
the sti^ent • could reply only with a number or a single word (often a single* 
letter) to questions posed by STAT. Even in the case of laboratory exer- 
cises, much better instruction can result if student replies take the form 
of entire phrases or mathematical formulas as well as numbers. For "tutorial 

and esqpository dialogues, such an expansion of possible student answer forms 
is a necessity. . 

b* Disadvantages for the Instructor 

Some on-line alteration of characteristics of STAT's behavior toimrd the 
student can be effected. (There are options reserved to the Instructor 
for this purpose;) The instructor may send information to STAT, via tele- 
type, to alter any combination of the following; 

. sample size for an exercise 

. level of significance or confidence level values that appear in the 
text of an exercise statement 







. probability distribution parameters (i.e. , population parameters) used 
in generating samples 

. order of presentation of exercises in the sequence 

. maximum, number of presentations for an exercise 

. the number of presentations for an exercise during which LIBRARY 
options are made available to the student 

The instructor cannot alter the type of probability distribution used to 
generate samples for an exercise, the text for an exercise, the criteria 
for acceptable, answers , or the recommended steps to a solution, unless he 
is proficient in JOVIAL programming. The same applies to augnentation or 
deletion of LIBRARY options; most critically, he cannot make subsets of 
the LIBRARY available or, unavailable for paarticular, exercises. Indeed, even 
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ina^top vere proficient In craaputer ppogranmlng, using the 
of ^ ’^thout PeprogreMnlng 



It VM Clear, ^ep examination of the SXAT trial experience, that an 
expanded ca^hlllty vas required fop on-line alteration of STAT's behavior. 
It ws equa^ clew that such alteration should not (and need not) require 
the Interventten of a professional computer ppograramer. Pop example , it 

trial that STAT ms not evaluating' the student's 
answers for a particular exercise correctly. The Intervention of a protcram- 
mep familiar vlth the JOVIAL language euikl vlth the Intricacies of STAT's 
a^r evaduatlon logic vas required In order to make this trivial program 
change, ft day elapsed before STAT vas altered and recompiled and 

this amended yewlon of the program vas available for student use. Similar 
problems arose ^n there vas a need to make minor changes in the text of 

^e^lMti^tloS^i“S2i’ messages frcin STAT, to remove ambiguities. 



c. 



Disadva ntages for the Lesson Designer 



course, tte lesson designer (author of an Instructional sequence) 
iatwatlm However, an author has an even greater ^ed for the 

Presumably, an Instructor will be 

mrklng with well-tested procprams that will require only modest Intervention 
mei^^hlB^t? tailor behavior to his taste or to the require- 

totfkfc^«^?ff'w ^ author, on the other hand, has a continual need 
to make changes vrtiUe he Is developing an Instructional sequence. In addl- 

tioSil for initial preparaSon of iSt?S- 

tlpnal^materlals. While SXAT has sene on-line alteration features, it has 

none that pe»it an author, unskilled In contputer ppograsming. to insert 

1^ “‘terlal together rttf specifications for 

1^8 presontavlon to the student* 



these disadvantages and to meet the project's pequire- 
merts for efficient generation (and siibsequent alteration) of various 

style, of J2PO®lto*y «nd tutorial sequences as well as laboratory 
exercises, FLAHIT vas developed, ^ 



C. PIAIIIT* (KKXSiAtHINO LAWOmcg FOR MTE8ACTIVE TEACHIBO) 



(I8lt [3]) Is a systw consisting of a language, a canputer oroerMi u>d 
the rule, governln, the us, of both, for building, ^liing.^d Znlllxl“g 



^ "PIAMIT, A 

^ C«®uter-Human Interaction," to be presented at 

the 1967 mi voln Computer Conference, Anaheim, California, November 1967. 
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TDresentation of CAI sequences. The major portion of the system design was 
completed by mid-January I966, following an analysis of the STAT experience, 
described above, and a survey of existing CAI software.* A first version of 
PIANIT was released for project use in May, I966, and the system has been 
operationeO- within SDC»s TSS with periodic improvements since that time. • 

PLANIT is the most important result of this project and represents a major 
step forward in CAI software. The following sections .provide a brief descrip- 
tion of the capabilities of the system and an exercise in lesson-building using 
PLANIT. A more complete description. is provided in Appendix 3 > ’’Brief User's 
Guide to PLANIT.” ^ 

1 . PLANIT Features 

The system is described .here from the viewpoint of an author of CAI material , 
e.g. , a teacher, who is called a lesson designer (LD). 

PLANIT operates in four modes: lesson building, editing, execution, and calcu- 

lation. Access to the System in any of these modes is always made via a key- 
board device such as a TT 5 f., The first two modes permit a teacher to construct 
and edit lesson frames in various formats and store them in designated sequences 
for later presentation to the student in the execution mode. The calculation 
mode is particularly oriented to mathematical subject matter and can be used as 
a calculation aid for the teacher (when building the lesson) or the student 
(when performing the lesson) . While the student has access only to modes EX 
(execution) and CALC (calc\ilation) , the LD may use all four modes. 

. Calculation Capability. PLANIT has an on-line calculation capability 
that allows either the' LD or the student to perform calculations involv- 
ing trigonometric functions, elementary algebraic functions, and matrix 
declarations. In addition, the calculation functions of PLANIT can be 
tied. in with the lesson. The LD can request the student to compute some 
results and can specify that the student's answer be compared with the 
results of evaluating a previously defined function. The LD can use the 
CALC mode to define the function when preparing the lesson; during ^ 
lesson execution, the CALC mode can be used again to test the student s 

answer . 

. Criterion Branching. The PLANIT language allows the LD to specify con- 
ditipns for branching based on the student's performance over any 
portion of the lesson. 



* *IBM’s "COURSEWRITER ' [ 9 ] ^ G. E . /Dartmouth ' s "BASIC" [ll] , Bolt Beranek 

and Newman's (Cambridge, Mass.) "MENTOR" and University of Illinois' "PLATO" 
[1] were the most important systems examined. Each of these systems lacked 
some feature deemed essential for efficient generation, editing and execution 
of statistics-oriented CAI. See Frye [ 4 ] , Chapter VI, for a discussion of 

desirable features of CAI software . 
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Conditions for branching may include: ^ 

Response latency on any one ansver or group of answers. 

Nmiber of errors made on any group of questions. 

• * . ^ 

Help received from the CALC mode (functions used or not usgd). 

The. actual path taken through the lesson up to this point. 

• ^ 

Ai^ combination of the above four points. 

. Service Routines . PLAHIT also provides the following service functions 
for evaluating student answers that depart from the anticipated responses 
specified by the LD : 

PHONETIC Comparison. This routine gives the student credit for his 
answer even though it is spelled incorrectly as long as it is phonetically 
equivalent to one of the LD’s answers. For example, PLANET and Fonetic 
cure acceptable wrong spellings for PLANIT and PHONETIC. 

KEYWORP Match. This routine instructs PLANIT to search for a set of 
words in the student *s reponse as the KEYWORDS of his answer. Further- 
more. if the lesson designer wishes, he may specify that the answer be 
evaluated as correct only if these keywords appear in a prescribed order. 



FORMULA Equivalent.* This routine will allow the student credit for 
his answer as long as it is one of a subset of expressions algebraically 
equivalent to any one of the LD's answers. For example, if one of the 
id's anticipated answers is 5/9^(F-32), then (5*F-l6o)/9 or 5*(f/9)-16o/9 
or (-32*(5)+5*F)/9 would be equivalent and . therefore acceptable. 



The LD can have any combination of these three routines turned off and on 
during lesson execution (even between actual occurrences of anticipated 
answers during student interaction with the lesson). 



2. Lesson Building with PLANIT 

This section explains how a lesson is written in PLANIT. A lesson is composed 
of a set of frames; frames are composed of groups; groups are composed of lines 
of information, such as text to be presented, anticipated answers, actions, etc. 




iERlC 
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*We believe this feature to b^ unique to PLANIT among CAI systems. 
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There are five frame types: Problem, Question, Multiple Choice, Decision, and Copje 

The Q (Question) frame is explained and illustrated below* The P, D, M, and 
C frames are discussed only briefly^* In the frame below, as in practically 
all PLA.NIT dialogue, data entered by the user follow an asterisk typed out by 
PIAKIT. A3J, data are entered via teletype. 



a. The Q(Question)Frame 
FRAME 1,00 LABEL=^HIST 

2. TECT. 

2. SPECOT QUESTION, 

*WH0 INVENTED THE ELECTRIC LIGHT? 
* 



3. ANSWERS. 
*A+TH(mS EDISON 
*B ALEXANDER BELL 
* 




t 

I 



I 




4. ACTIONS. 

*A F: THATS VERY GOOD B:3 

*B R:HE INVENTED THE TELEPHONE, TRY AGAIN,,. 

*-R; 

*-C: 

Explanation of Frame 1 

First line . All frames are automatically numbered by the program; the LD 
provides the labels. Here the LD chooses to label the frame HIST, (if he 
chooses not to label the frame, he strikes the space bar and the carriage 
return and passes on to Group 2. Group 1 consists merely of the frame 
label.) In Group 2: TEXT, the LD is not sure what TEXT means and types in the 
question mark (?), PLANIT immediately repeats the group number, 2, 'hnd 
' elaborates. The LD then types in his question, WHO INVENTED THE ELECTRIC 
LIGHT? PLANIT returns with an asterisk, waiting for more lines of input. 

PLANIT has no way of knowing when the LD is through with the question group 
and so returns with an asterisk for each next line. The LD ends the group 
by striking the space bar once and then the carriage return key. There is 
no theoretical limit to the number of lines that can be entered in each 
group. There is, however, a practical limit of 63 lines for the entire 
frame . 



*See Appendix 3> especially pages 104 to I09 for jKii^her details about these 

frame types. 
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In Group 3; ANSWERS, PIANIT is asking the user to SPECIFY ANSWER, The LD 
now enters all the anticipated answers, tagging the first one A aM the 
second B, etc. The plus sign (+) next to the A indicates to P^IT that 
this is the correct answer. The LD then indicates the end of the group y 
striking a space bar and carriage return. 



In Group h: ACTIONS, the LD user is requested to SPECIFY ACTIONS to he 

TAKEN, depending upon which answer the student gives. 



There are four types of coisiaands in the action group! 



p* What follows is the feedback message that is to be presented to the 
student. If no message follows F: , PIANIT will choose one rando^y fwm 
its stored list of feedback messages, according to whether the student s 
answer was correct or incorrect. The LD can thus enter F: by itself, 
knowing that the student will not get a monotonous YES or NO when he 
enters an answer. (Responses are usually one-word messages such as FINE, 

YES, CORRECT, NO, WRONG.) 



R: This command instructs PIANIT to wait for another answer without 

Minting the question again. It can be entered along with an appro- 
priatc^ssage such as in the above example. In this case the student 
deceives the feedback: HE INVENTED THE TELEPHONE, TRY AGAIN; and PIANIT 

then waits for another answer. R: by itself instructs PIANIT to print 

out a fixed message (WRONG, TRY AGAIN) and wait. 



C: This command used alone instructs PIANIT to print out the fixed. 

message: THE CORRECT ANSWER IS, followed by the correct answer Undl- 

cated by the plus sign in. Group 3). C: can be followed 

command«F: , R:,, B: or .a CALC statement. For exan?>le, C: CO^=COUN^ 

or C*X*PACT(3). This puts PIANH! in the CAI/3 mode. COUNT and X are two 
exan^ies of items in CALC. Here COUNT is to be incremented by one and X 
is set equal to PACT(3), i.e*> the factorial of 3*. 



B* This instructs PIANIT to branch (B:3 means BRANCH TO FRAME 5)* All 
f^s are numbered; they can also be labeled and a branch can ^ 
to any numbered or labeled frame. In addition, B:I5NAM (where JSNAM is 
the of another lesson) means that the lesson IBNAM will now be 

brought into PIANIT and executed as a part of the current lesson; the 
student will never know the difference. Upon completion of the lesson 
LSNAM, PIANIT will continue with the next frame in the original lesson. 

B: by itself causes PIANIT to return to the calling lesson. For 

example, if during lesson AA the command B:BC is encountered (where BC 
is a lesson name), lesson BC will be called and run until the conmnd B: , 
in lesson BC, automatically returns PIANIT to lesson AA. Similarly, 
BiPRGM means branch to the program whose name is PR^. When PRGM re n- 
quishes control, execution continues with the next frame in the calling 

lesson. 
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The first user input in Group 4 is read as follows; If the student gave 
answer A (THOMAS EDISON), print out the message; THATS VERY GOOD and 
branch to B^ame 3. 

The second ii 5 )ut is interpreted as follows: If the student gave answer B, 

print out; HE INVENTED THE TELEPHONE, TRY AGAIN... and wait for another 

answer. 

« 

The third input, prefaced by a minus sign, indicates an action to be per- 
formed if the student’s answer did* not correspond with either A or B — namely, 
for any unanticipated response, wait for another answer, (in this case, 
since nothing appears after the R;, PLANIT then prints out the fixed messagp; 
WRONG, TRY AGAIN, and waits for another answer.) 

The LD may then select the same or another frame tj^ and continue to build 
his lesson. 

The Q frame is the cornerstone of any interactive tutorial dialogue with 
the student. Even a casual user of PLANIT quickly masters the use of this 
frame. The small (but powerful) set of Group 4 action commands, F, R, C, 

B, permits him to prescribe flexible branching and feedback messages 
appropriate to the student's response to a question posed in Groiq? 2. 

b. The P(Problem) Frame 

This frame type is designed especially to provide the "environment" for 
statistical laboratory exercises. The U) may use as many as nine informa- 
tion groups to specify; 

. ft*obability distribution parameters for generating data in the form 
of pseudo-random samples, e.g., means, variances, and correlation 
coefficient for a bivariate Gaussian (normal) distribution. The 
random data would actually be generated for student use during the 
execution, for example, of a statistics lesson (the LD can also 
specify headings and format for the actual printing of the data). 

The amount of data to be generated may be controlled by the student 
or the ID according to the latter's prescription. 

. Steps to the solution of a problem in which the random data will 
be used (the student receives one step at a time in response to his 
request "STEPS"). 

. Controls over the mathematical functions that shall (or shall not) 
be made available to the student vrhen he attempts to solve a particu- 
lar problem. 

When this frame is used in conjunction with Q frames (preceding and follow- 
ing) , the LD can construct instructional sequences such as that provided by 
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STAT (without any of the disadvantages of that program described earlier). 

A preceding Q frame j usually consisting only of Groups 1 and 2 , is used to 
present a textual description of conditions giving rise to the pseudo- 
random data. The Q frame that follows the P frame will usually contain 
information in 1 four groups, including a. question that requires the 
student to perform some computation on the data before he is able to reply; 
anticipated answers stored as . functions (of the unknown and as yet ungener- 
ated sample data); and appropriate action commands and feedback messages. 

(See Appendix page lUO, where these frames are combined in the prescrip- 
tion of a computational exercise for a lesson in descriptive statistics 

called DESCBB.) 

/ 

c. The D(Declsion) Frame . 

The action commands (F, R, C,B) in the Q frame permit the LD to specify 
lesson execution behavior as a function of only those events that occur 
in connection with the execution of a single frame (including repetitions 
thereof). The Decision fl-ame affords the LD an opportunity to consider 
more complex branching decisions (and other actions as well), as a function 
of the student *s performance history, i.e., as a function of events that 
have taken place across a set of frames. He may use two basic forms in this 
connection. 

The first form, called the pattern form, allows one to inquire if the 
stvidfent took a particular path throu^ the material. For example, let us 
• ima^ne the student went through Frame 1, answered A or C, and followed it 
by Fr^e 5 (in which, he responded incorrectly) , and then followed that by 
Frwaes 10 through 15, where the student was correct. An inquiry concerning 
Whether or not the student went through that pattern exactly with no 
deviations 6an actually be written in the language pretty much as it has 
been stated. For exwple: . 

IP 1,AC 5,- 10 - 15 ,+ 

This, then, is the form of the pattern question. If the query is answered 
affirmatively, one can then use any combination of the three action commands: 

F:, C:, and B:. 

The second form permits queries about summarized student performance over a 
set of frames. For example, one may want to know if the student got less 
than or equal to five right out of Frames 10 through 22 and Frames 30 and 
33. This can also be written, almost as stated, in the following manner: 

IF LQ5 RIGHT 10-22,30,33. Similarly, if these conditions are satisfied, 
any of the three commands can then be executed. In place of RIGHT, one 
can substitute \^0NG, SEEN, MINUTES, USED. With USED, one can have any 
function like. FACT (factorial), SIN, COS, etc. For example: 
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IF GQ 5 MINUTES 10-15 B;10 
IF SIN USED 6 B:7 

means: If the student spent at least five minutes- on Frames 10 through 15, 

then branch to Frame 10. The second IF statement reads: If he used the 
function, SIN in iFrame 6, then branch to Frame 7. Also, in place of GQ one 
can substitute LS for ^^ss than, GR for greater than or other relationals 
such as LQ, NQ, EQ. Finally, one can use IF statements to query the con- 
tents of items set in the calculation mode. IF IQ LS 50 B:W0RK means: If 

the item whose name is "IQ" contains a "^ue less than 50, branch to the 
frame whose label is "WORK." 

All these forms can be connected as one large statement via the connectives 
AND and OR, e.g.: 

IF 1,AC 5, - 10-15,+ ^ 

OR GQ 5 HTNUIES 10-15 AND USED SIN 6 

AND IQ LS 50 BjWORK ' 

d. The M (Multiple Choice) and C(Copy) Frames 

The M frame is almost identical in all respects to the Q frame except that 
it causes a presentation to the student of a "tagged" list of answers 
specified by the LD (the correct answer designators, of course, are omitted 
from the presented list). The student, instead of constructing a response 
in reply to an M frame message, selects and types a literal answer tag. 

The M frame is very useful for cases in which elaborate forms of student 
response are req-uired (often too time-consuming to type) or where the set 
of "Correct" constructed responses may include too many variations, with 
respect to contenf' and format, around one basic form. 

The C frame is mainly a lesson building and editing convenience. \*/here 
the LD needs another version (with some minor differences) of a previously 
constructed frame, he can have it copied by calling for a C frame in the 
lesson building mode, designating which frame is to be "copied," and 
effecting minor alterations thereafter. 

e. The CAK; Feature and Expository Lessons 

We have mentioned the on-line calculation capability of PLANIT; Appendix 3, 
Pages 92 to 97,^ contains a partial list of the variety of mathematical state- 
ments or expressions that may be employed by students (or other users) for 
on-line numerical work. These statements and expressions can also be 
"stored" by the LD in D frames and Q frames to provide valuable numerical 
demonstrations of statistical concepts when those frames are executed for 
the student. 
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Consider 'the following portion of a TTY record. Figure 1, obtained 
during a demonstration of the fact that care is required in interpreting 

observed sample values of the (Pearson product moment) correlation coeffi- 
cient, The replies of a mythical "student" are underlined in this record. 



CORBEIATION AlfD INDEPENDENCE 

IT IS OFTEN (HKJORRECTLY) CONCLUDED THAT A CORRELATION VALUE CLOSE TO ZERO 
IMPLIES A LACK OP RELATIONSHIP BETWEEN TWO VARIABLES, THE FOLLOWING SAMPLING 
EXPERIMENT INDICATES THIS IS NOT ALWAYS THE CASE. 

CONSIDER THE FOLLOWING SAMPU: OP SIZE 'N* FOR THE VARIABLES, X AND Y: PLEASE 
CHOOSE A VALUE FOR ‘N* (BETWEEN 10 and 30). * 

N - 1^ , 

YOUR SAMPLE AND THE CORRELATION COEFFICIEHT FOR THIS SAMPLE, 'RHO,' FOLLOW; 



1 - 


S .7757 


7 .5774 


• 


7.4451 


7 .471 4 


. 


7.771 4 


7 .7 «95 


s- 


5 .7921 


7.7777 


S- 


4 .5549 


7.99P4 


A- 


1 .4777 


7.9P97 


7- 


5.7579 


7.5713 


P- 


4 .777,7 . 


7 . 9P7 i 


9- : 


4.3551 


7.9477 




1 .4PP9 


7.9957 


-0.11+2 







. 

HOWEVER Y IS PERFECTLY PREDICTABLE FROM X: THE COMPUTER USED THE ABSOLUTE 
VAIOE. OF SIN(X) IN TABULATING THE VALUES OF Y SHOWN ABOVE FOR EACH RANDOM 
OBSERVATION ON X. «« ^ 

THE CLOSER *N’ IS TO 30, THE MORE LIKELY ARE SMALL VALUES FOR 'RHO'. WANT TO 
TRY IKES AGAIN? YOU MAY VARY ‘N* IF YOU LIKE. 



FIGURE !•* Correlation and Independence 

^^on repetition of this "experiment" for N ■ 20 and N = 30, RHO values of 
0.167 and -0.099, respectively, were obtained. The "population" correlation is 
actually zero for these two variables; this can be proven mathematically, i.e,, 
if X Is uniformly distributed on the interval [0,2?r] and Y « I SIN (x) 
and Y are statistically Independent .(uxxsorrelated) variables (even the 
knowledge of X is sufficient to predict Y with certainty). 



. . . , then X 
though a 
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Such demonstrations, in which the student is free to vary a critical param- 
eter, e.E., sample size, give the student (and his instructor) accelerated 
experience in stochastic phenomena, without the Oomputational drudgery. In 
addition, th6 preparation of such CAI sequences is relatively easy with 
PIANIT; the lesson used for Figiare 1 was built in one hour, including 
debugging time. It consists of six frames: four Q fr^es and one each of 

the P and D type. The hour also included time to label the lesson as 
CORR and store it in the TSS disc memory, from which it could be retrieved 
for immediate execution by any authorized user. 



The next section describes four lessons that have been subjected to trial 
use by students at two coliege campuses. The trial results are discussed 

in Part III. 



D. LESSOnS 



The project staff used PLANIT to construct four lessons, INTRO, DESORB,* PROBl 
and PROGS'!*. Each is described below with brief statements about lesson pre- 
requisites, objectives, content and style; excerpts from TTY re(:ords of various 
students work are included, at the end of each description, to illustrate content, 

and style. 




1 . m m , 



IRTRO is a CAI lesson of approximately one hour’s duration,** It presents the 
essential teletypewriter communication procedures and certain symbol conventions 
tliat the student must understand and use with PLANIT-administered instruction. 



Prerequisites 






It is recommended (but not essential) that students be acquainted with the 
nature of time-shared computer systems and their use in CAI applications 
before beginning INTRO. They should have seen a demonstration on operating 
the teletypewriter. For some portions of the lesson, a mathematics back- 
ground equivalent to that provided in one year of high school algebra is 
assumed. 



Objectives 



The primary objective is to prepare the student for effective communication, 
via telet^'pewiter, with PLANIT operating in the lesson execution mode. 

A portion of the lesson is devoted to preparation applicable in a3JL types 
of subseauent lessons. However, most of INTRO is devoted to a subset of the 
more specialized PLANIT conventions and’ procedures required for mathematical 
or statistical subject matter. 



*Hore detailed descriptions of DESCRB and PROGM may be found in Appendices k and 5. 

■>^*Basc.l on a sample of l4 college undergraduates, the median time for completion 
|pf INTRO is 73 minutes with a range of 56 to 8?- minutes. 
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Content. 

^ ^ ^ T T 

The sequence o^ topics in INTRO does not appear entirely in the order used 
to describe them here ^ The location and role of certain teletype-vnriter keys 
is pointed out and the student is given practice in their use; the "RETURN” 
key for sending typed messages to the coTT 5 >uter, "RUBOUT" for "erasing" 
single characters, and upper case "2" (i.e,, quotation mark key) for can- 
celling ail of the characters that have been typed on a single line. The 
student is also, told .that- the computer will present an asterisk when it is 
ready to receive his reponse, which may taJte one of two forms, multiple 
choice or constructed; the latter may be numerical or literal. Finally, the 
student is introduced to the location of the keys for symbols used in tj^^Ding 
arithmetic expressions, e,g, , /, +, for multiplication, subtraction, 

division, and addition, respectively, and is given practice in their use. 

Also covered is the use of parentheses to avoid .ambiguities in arithmetic 
expressions and to set off: arguments for a particiiLar function, SQRT(x), 
for the square root of the number X, ..(Other functions are introduced in 
a lesson called DESCRB, designed to follow INTRO, DESORB is described 
below, ) 

The student is taught to distinguish between a response, on his part, con- 
sisting of a mathe^tical expression, and the numerical evaluation of that 
expression. For the latter, he must preface his e:q>ression with to 
enter PLANIT ' s CALC, mode ; he uses to return to the lesson execution 
mode with his numerical, results, so that they may be judged correct or 
incorrect. The lesson contains ten practice problems requiring entry to, 
and returp from, the CALC mode, 

. f ■ _ • • . 

Styles Employed • . . . 

The instructional style employed in this lesson consists, for the most 
part, of presentation of short expository passages followed immediately by 
questions or exercises designed to^test the student's understanding of 
these passages. Initial failures to comprehend, as determined from his 
answers, are treated by giving the student the -correct answer and advancing 
hir.i in the lesson, / Repeated failure results in a stepping back to material 
of lesser difficulty, and if the student still cannot supply correct answers, 
he is advised to* seek outside help. The student has no control over the 
presentation sequence except near the end of the lesson, where he may 
elect to do only a subset of the exercises offered him, 

i 

Illustrations 



Figiu:es ?. , 3> and h on the following pages are excerpts from a student's 
teletj'pewriter record of his work vrith lilTRO, The student's replies are 
'.mder lined. 
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YES 

BOOD, 



» LESSON IRCRO <= 

!T 

♦ icTHE 'RETURN* KEY** 



INO THE -RETURN* KEY ON YOUR TELETYPE -- T BE 0 T 

SIDE OF THE KEYBOARD. IF YOU DON'T SEE IT, GET HELP. ONCE ^ 

HAVE FOUND IT, TYPE IN THE WORD -YES* AND STRIKE THE RETURN KEY 

(DON'T WORRY ABOUT SPELLING.) 



♦♦ALWAYS WAIT FOR THE ASTERISK^^ 



nil tjfi I MOTirF THAT AN ASTERISK PRECEDES YOUR ANSWER. BEFORE YOU 
CAN SENn SLIaGE you HUST RECEIVE AN «TERI SK F.ROH THE ^ 

TUP tells you to *G0 AHEAD* • AFTER YOU HAVE TYPED IN 

YOUR ANSWE^OR^lN^ HIT THE 'RETURN* KEY TO ^^ELEASE THIS 

INFORMATION INTO THE COMPUTER. DO YOU UNDERSTAND? YES/NO 




KID 



ME... ANSWERING 'NO* INDICATES THAT YOU UNDERSTAND 



♦ ♦ 



•DOUBLE QUOTES* CANCELS A LINE 






rYPING IN INFORMATION OR ANSWERS ^ tup'' •r|?uRN-’^KEY IS 

• cDTi I Tu-i«5 AlirKFT* OR RELEASE THE INFORMATION# THE RETURN ‘\c.t i3 

don*; WANT''?rRELEASrTH^ 

1ust\yped!''*the^ca^ will return automatically giuing ydu a 

CLEAN LINE! COMMENCE WITH YOUR CORRECTED LINE IMMEDIATELY SINCE NO 
NEW ASTERISK WILL BE GIS/EN TO YOU. 



FOR PRACTICE, COPY THESE LETTERS INCORRECTLY# USE THE DOUBLE OUOTES 
O^THru^PER CA^^^ then TYPE THEM AGAIN CORRECTLY, 



POHNF 



i*PQWNF 

WRONG# TRY AGAIN. 



♦ PQHNF** 



PQHNF 



YOU TYPE WELL.... 




FIGURE 2. IKCRO Excerpt 

(This Illustration is taken from the very beginning of the lesson.) 
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’««MATHE;!iATICAL COWPUTATI ONS** 

. . . • ■ ■ ' . « . 

tT ,I$ OFTEIN DEStRABLE to PERFd FARTS OF A NUMERICAL PRO^EM OR TO 
KNOW THE VALUE OF AN ALGEBRAIC EXPRESSION BEFORE TYPING IN TME 
FINAL ANSWER. 



TO MEET THESE NEEDS# WE HAVE MADE AVAILABLE A FEATURE CALLED THE 
•CALCULATION MODE*. TO GO INTO THIS MODE AFTER YOU HAVE RECEIVED AN 
ASTERISK FROM THE COMPUTER# YOU MUST TYPE THE HORIZONTAL ARROW *-* 

ON TRE upper CASE 'O*. 

AT THIS POINT YOU MAY DO AS MUCH CALCULATING AS YOU DESIRE# HOWEVER# 
YOU CANNOT ENTER A COMPUTED ANSWER TO THE LAST QUESTION WHILE IN 
THIS MODE. 

TO ENTER THE COMPUTED ANSWER# YOU MUST USE THE VERTICAL ARROW *f* 

AND TYPE YOUR ANSWER IMMEDIATELY TO THE RIGHT. THIS ARROW# • t • ON 
THE UPPER CASE *N* TAKES YOU OUT OF THE CALCULATION MODE. 




I 




t 




ERIC 



'hfiiiniiiiffnffTiaaa 



lyik 



0 , 

HOW DO YOO enter the ^CALC* mode? (A or B# BELOW?) 

A TYPE IN A VERTICAL ’t* ARROW. 

B TYPE IN A HORIZONTAL *•-• ARROW. 

♦t. ' ' ' ' ' c \ ‘ 



ENTER YOUR ANSWER. 

♦ TYPE IN AVERTICAL ARROW 
CHOOSE ONE OF THE ABOVE LETTERS. 

NO# YOU WOULD TYPE THE HORIZONTAL ARROW. 



I 

. • • , 1 

OTSGURE 3. ^ 



(Note the student's strugcp.e to find the correct mode of respox)se to a multiple 
choice question. ) 



t 



# 






..N;- 



iiiiiiiait 
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EVALUATE THE EXPRESSION *6»*7*? 



fF YOU HAPPEN TO GET STUCK IN THE CALCULATION NODE, GET SOHE HELP. 
WHEN YOU HAVE FINISHED YOUR COMPUTATION# COMPARE YOUR ANSWER ANO 
TYPE IN THE APPROPRIATE LETTER# 



A R79936 
a 1679616 
C 10377696 
0 60466176 



♦ #» 6 * 6 » 6 * 6 * 6 * 6<»6 

R79936 

♦ t A 

EXCELLENT 




FIGUBE 4. OTRO Excerpt 

(The symbol •<*** is tused for raising a manber to a power but this student chose 
to raise 6 to the 7th power through multiplication,) 

t 

2, DESCBB 

DESCRB» is a CAI lesson on descriptive statistics designed for undergrad^es 
in beginning courses on statistical inference# A student will require ftom 1 
to 2 hours to complete his work with DE^BB. 

Rpereouisites 

It is recommended that the student complete the lesson ^ 

Chanters 3-5 in Guilford (61 prior to taking DESCBB. In^dltlon, the 
student will need to refer to two handouts (containing a frequency table , 
f Ms?oi^ 2SS a ^gon shown on pages 122 and 123, Appendix 4) in order to 

answer certain questions posed by DESCBB. 

Objectives 

The objectives of DESCBB are (l) to review certain 

statistics and (2) to give the student supervised practice in the use of 
FIABIT's calc mode# Hte uses this mode to do statistical exercises. 



«See Appendix 4 for more details on DESCBB# 






Topics included in the descriptive statistics instruction are: grouping 

of data, frequency distributions, histograms, frequency polygons, measures 
of central tendency and variability, and computational techniques. In 
addition, the contentions for using CALC are presented and several CAK: 
functions (e,g, , summing, summing squares, etc.) are provided to simplify 
the student *s computational tasks in the exercises. 

Styles Employed * 

The style primarily consists of tutorial sequences followed by practice 
exercises. Several criterion questions are also included to determine 
whether a particular student needs the available remedial or repeated 
instruction. 

Illustration 

Figure 5 shows a sample of teletypewriter dialogue between a student and 
the lesson where the student is being shown the effect of calcinating 
deviations of scores from some point other than the mean. Notice that the 
student is aeked to supply that point. 

The typed messages prefixed with an asterisk are responses supplied by the 
student. Underlining has been added to designate his responses in these 
sample records. 
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LET ^S GENERATE ANOTHER COLUMN OF SCORES AND A COLUMN OF 
DEVIATIONS FROM THE MEAN. 





SCORES 


DEVIATIONS 


ITEM 


COL. 1 


COL. 2 


1- 


82 


26.8750 


2- 


26 


-29.1249 


3- 


94 


38.8750 


4“ 


3 


-52.1249 


5- 


62 


6.8750 


6- 


28 


-27. 1249 


7- 


93 


37.8750 


8- 


S3 


-2. 1249 




THE DEFINITION OF THE VARIANCE ISl *THE SUM OF THE SQUARED 
DEV IftTIONS FROM THE MEAN# DIVIDED BY N*. SO IN ORDER TO COMPUTE 
THE VARIANCE OF THE ABOVE SCORES WE SQUARE EACH VALUE IN COLUMN 2# 
SUM THE SQUARES# AND DIVIDE BY THE NUMBER OF VALUES IN COLUMN 2. 

COMPUTE THE VARIANCE OF THE SCORES IN COLUMN 1. (REMEMBER THE 
FU ICTIONS YOU LEARNED IN YOUR FIRST LESSON.) 



♦ •SS(2)/8 
1002.6066 

♦ t 1002. 6066 
VkRY# VERV GOOD. 



WHAT IS THE STANDARD DEVIATION OF THE SCORES? 

♦ *S0RT(SS(2)/8) 

31 . 6640 

♦ t31 .664 

VERY GOOD. YOU l^ING T^E BELL. 



XXXXXXXXXXXXXXX)(X)(X’XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX)(XXXXXXXXXXXXXX 
1*LL MARK THIS PLACE BECAUSE YOU WILL HAVE OCCASION TO LOOK BACK 
AT YOUR ANSWERS ABOVE. 



FIGURE 5. An Excerpt from a Student's Dialogue with DESORB (Sheet l) 
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r- 

f. 




COLUMN 
* 12 


OF 


DEVIATIONS. 


r 




0 . K . 


HERE ARE YOUR NEW 
SCORES DEVL 


f 




ITEM 


COL 


. 1 COL. 2 






1- 


82 


1 4.8750 






2- 


26 


-41 . 1249 






3- 


94 


26.8750 


1 




A- 


3 


-64. 1249 






5- 


62 


-5.1249 


P 




6- 


28 


-39.1249 


i 




7- 


93 


25.8750 






8- 


53 


-14.1249 






I- 



l- 



i 



NOW LET'S SEE WHAT HAPPENS WHEN THE DEVIATIONS ARE TAKEN 



FROM SOME POINT OTHER THAN THE MEAN. TYPE IN A NUMBER BETWEEN 



5 AND 15* * I WILL ADD THIS VALUE TO THE MEAN AND COMPUTE A NEW 



NOW APPLY THE VARIANCE FORMULA TO THE VALUES IN COLUMN 2 AND 
TYPE IN YOUR ANSWER. 



» *-SS(2)/8 
1 1<46*6053 



6053 



NO* TRY AGAIN. 



*t 1 1 46. 6053 
VERY GOOD. 



COMPARE THIS 'VARIANCE' WITH THE VARIANCE YOU GOT WHEN THE 
DEVIATIONS WERE TAKEN FROM THE MEAN. 



TYPE IN THE LETTER ASSOCIATED WITH THE TRUE STATEMENT. 



i 



A THE VARIANCE IS SMALLER WHEN THE DEVIATIONS ARE TAKEN FROM THE MEAN. 
B THE VARIANCE IS LARGER WHEN THE -DEVI ATIONS ARE TAKEN FROM THE MEAN. 

C THE VARIANCE IS NOT CHANGED BY CHANGING THE DEVIATIONS. 



■ 



*A 

THAT'S RIGHT. 






RECALL THAT 'VARIANCE' WAS DEFINED AS THE SUM OF SQUARED 
DEVIATIONS ABOUT THE MEAN DIVIDED BY THE NUMBER OF OBSERVATIONS 
IN THE SAMPLE. YOU HAVE JUST SEEN A DEMONSTRATION OF ANOTHER 
IMPORTANT PROPERTY OF THE SAMPLE MEAN* SOMETIMES CALLED THE 
•LEAST SQUARES' PROPERTY. 



I : 



LEAST SQUARES PROPERTY: 
SAMPLE IS MINIMIZED (I. 
F ROM THE SAMPLE MEAN. 
SAMPLE MEAN THE M.n 



THE SUM OF SQUARED DEVIATIONS FOR A 
E.* LEAST) WHEN THE DEVIATIONS ARE MEASURED 
IF YOU SUBSTITUTE ANY OTHER VALUE FOR THE 
SQUARED DEVIATIONS WILL INCREASE. 



FIGURE 5. (Sheet 2) 
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3. raoBi 

PROBl in dosignecl as the first in a. planned series of CAI lessons for reviev of 
the basic ideas in elementary probability theory, (Thus far it is the only 
lesson in the series that has been prepared.) This lesson steers a middlq^ 
course between an abstract mathematical presentation and an intuitive treatment 
of the probabilistic concept of event from the standpoint of elementary ideas 
about sets. Additional lessons in the series are planned that \dJJL take up 
such notions as independence, conditional probability; and Bayes* theorem, 

nine under pxnduates have used preliminary versions of various segnents of PROBl, 
This experience indicates that the lesson described here could be completed in 
to 2J- hours by students enrolled in a beginning statistics course. 



Prerequisites 



It is assumed the student has had two or three hours of classroom discussion 
or lectures devoted to such concepts as sample space (universal set), 
simple events (points in the sample space), composite events (sets of points) 
and the Boolean operations of union, intersection and complementation on 
composite events. It is further assumed that he has completed readings on 
probability in his statistics textbook,* The student also should have com- 
pleted the CAI lesson INTRO before beginning PROBl, 

Objectives 



PROBl provides a review of the concept of event, which is usually treated • 
too hastily for most students in a beginning statistics course. It also 
attempts to strengthen the student *s ability to translate from a verbal 
description of an event to its representation as a set of "points," i,c,, 
a set of possible outcomes- of a random experiment. 

Content > 

"niinplo" (also called "elementary") and "composite" events are defined and 
illustrated in coin-and dice-tossing experiments. Then more abstract 
representations of these two types of events are presented and used in 
place of verbal descriptions for possible outcomes of random experiments. 
Elementary ideas from set theory are introduced, such as methods of defin- 
ing sets,:the universal set, the null set, and unions and intersections of 
sets. Toward the end of PROBl, probability assignment is treated in the 
. elementary case where each point in a sample space is assigned equal proba- 
bility, (i,c,, is "equally lUcely"), The student is then asked to deter- 
mine the probability of occurrence ‘of various composite events by counting 
the "points'* or "simple events" that are included in these composite 'events, 

*For example. Chapter 3 in the text. Elementary Statistics by Paul G, Hoel, 

[ John V/iley and Sons, New York, I966, 
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The lesson concludes by introducing the concept of mutually exclusive 
events, the addition theorem for probability, and applications of both. 

Styles Employed 

PROBl uses a tutorial style. Short descriptive or expository passages are 
followed by questions to the student. These require replies consisting of 
a word or two, or more frequently, a number. The student who replies 
incorrectly is usually given a hint designed to suggest the correct answer 
and another^opportunity to reply. If he continues to "miss" he is given the 
correct answer and advanced in the lesson. At certain points in the les- 
son, if his performance has been extremely poor, he is advised to "sign 
off" and seek outside help. 

The lesson is entirely computer administered with one exception. The 
student is asked some questions which refer to Venn Diagram, representa- 
tions of sets. The required diagrams are shown below. 

Illustrations 

Figures 6 and 7 are the aforementioned Venn diagrams. Figures 8 and 9 
provide brief excerpts from a student's dialogue with PROBl. The latter 
are teletypewriter records where only the student's replies are underlined. 



UNIVERSE »A* 




FIGURE 6. Venn Diagram of Universe 'A' with Set 
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FIGURE 7. ‘‘Venn Diagram of Universe *B' with Sets *P' and *Q' 



i 






'V*cr jr^V.'T’VV'* '^/.~^ ?♦ V£i^-'^7^y7?'r:r 
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LFSSON PROR1 --F:LKMI^NTAc?Y PRORARILITY 



PRORARILITY is that RRANCH of MATHFMATin'^ WHICH TR«^ATS OF e*V=*NTS 
AND N’lMRFRS AS50CIATFD ^ITH TH»^SF FVFNTS * CALLFO PROPAR IL IT 1^“ S . 
IN PROP! WF WILL CONGFNTRAT'F ON THF CONCrpj OF pV/FNT. LATFR ON, 
IN'^PRORR* WF WILL CONS I OPR PRGRAR I L T T IFS . 



TO THF PROPARILIST ALL FVFNTS PALL INTO ONP OP TWO CATppoRIPS: 

I 1. SIMpLP FVFNTS 

R. compos ITP FVFNTS 




V 







I 

3 

f 

I 



I' 

I 



i. 

l 





SIMPLE FVFNTS-THF SAMPLE SPACE 

IF YOU TOSS A COIN* AS A PROPAR IL I ST*' YOU ASSUME THAT ONP OP T 
OUTCOMES WILL RESULT*HEADS OR TAILS*AND YOU WO'ILD CALL pACH QP 
THESE TWO DIFPERFNT RESULTS A 'SIMPLE EVENT*. 

IP YOU WERE TO TOSS A SINGLP COIN TWICE. HOW MANY niPPFRENT, O'lT- 
COMES ARE pOSSIRLE RESULTS OP YOUR RANDOM EXPERIMENT? 

NO. HOW MANY DIFPERENT RESULTS IN ALL * ARE POSSIRLE 
IF YOU CONSIDERiE.R. * * HEADS* HEADS * A SINGLE POSSIPLP O'ITCOmp* 
•TAILS*HEADS* .ANOTHPR* FTC. TRY AGAIN. 

*3 

VERY GOOD. SUPPOSE HOWEVER YOU WISH TO DISTINGUISH 'HEADS .TAILS' 
FROM *TA ILS.HEADS* HOW MANY DIFFPRENT RPSULTS IN ALL THEN? 



*4 

GOOD. 



SUPPOSE YOU TOSS A COIN THREE TIMES? HOW MANY DIPPFRENT RESULTS-ARP 
POSSIBLE FOR THREE TOSSES? 

NO--FOR TWO TOSSES WE HAD FOUR DISTINCT POSSJRLP OUTCOMPS: 

H H - 
H T - 
T H - 
T T - 

THE result of the THIRD TOSS WAS LPFT OUT AROVP. THINK AND TRY AGAIN. 
CHPCK. 



FIGURE 8. IROBl Excerpt 
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<<THE POOL SHAPK>> 

A POOL SHARK CLAIMS HE CAN TELL THE WEIGHT OF A C'JE WITHOUT INSPECT- 
ING THE LAREL. YOU DECIDE TO TEST HIS ABILITY USING THREE CUES 
WHICH WEIGH P LB.# R LB. 0 OZ.# AND R LB. 5 OZ.# RESPECTIVELY. 

YOU ASK HIM TO PLACE THE LIGHTEST CUE IN RACK NUHBER 1# THE NEXT 
HEAVIEST IN RACK NUMBER R» AND THE HEAVIEST IN RACK NUMBER 0 AFTER 
MASKING THE LABELS. 



FOR THIS EXPERIMENT# HOW MANY POSSIBLE OUTCOMES ARE THERE? 



*9 

NO# TRY AGAIN. dJSE NUMBERS.) 



*6 

YES. 



HOW MANY OF THESE POSSIBLE OUTCOMES OR ELEMENTARY EVENTS MAKE UP THE 
COMPOSITE EVENT# *AT LEAST TWO CUES ARE CORRECTLY ASSIGNED TO THE 
RACKS'? 



WRONG# TRY AGAIN. 

0 *2. 

1 f NO. THE CORRECT ANSWER IS ONE. 

V -y' 



IS THIS EVENT IDENTICAL JO THE EVENT 'ALL THREE CUES ARE CORRECTLY 
ASSIGNED? 

YES 

CORRECT. 



SUPPOSE THAT THE COMPOSITE EVENT IS THAT ONE AND ONLY ONE CUE IS 
CORRECTLY PLACED) HOW MANY ELEMENTARY EVENTS MAKE UP THIS COM- 
POSITE EVENT? 

YES. 



HOW MANY ELEMENTARY EVENTS MAKE 'JP THE EVENT# 'AT LEAST ONE CUE IS 
CORRECTLY PLACED'? IF YOU iNEED HEL®# SAY 'I DON'T KNOW.' 

•I DONT KNOW 

ALL 'r I SWT# LET'S DEVELOP IT. 



FIGURE 9. HtPBl Excerpt 

(This problem is presented to the student in the last third of the lesson cuid 
is designed to test vhether he has assimilated the important ideas in FROEl.) 
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4. PROGM 

EROGM*<- is a CAI lesson designed to introduce students in elementary statistics 
courses to computer programming concepts and the use of the programming 

language as an aid to problem solving. Three levels of computer programs are 
involved in t.lie presentation of PROGM: first, a time-sharing system (TSS) 

program that supervises all activities on the computer for as many as 25 simul- 
taneous users; secondly, the PIANIT instructional system program (under the 
control of TSS) that supervises the administration of the lesson and collection 
of student records; and finally, the lesson itself, which is comprised of 
instructional frames and the TINT programming system. TINT does not normally 
require the supervision of PLANIT; it will operate directly under TSS. However, 
the fact that PIANIT can also supervise the operation of TINT allows the student 
to do programming exercises in this language while he is being taughir to use it 
by PROGM. No student has yet had an opportunity to interact with the entire 
lesson; however, a crude extrapolated estimate of the time required to complete 
this lesson is five to fifteen hours. 

Prerequisites 

It is assumed in PROGM that the students are receiving concurrently or have 
previously 4 peceived instruction in elementary statistics. Statistical 
problems are used for the programming exercises. These include computation 
of sample means, variances, standard deviations, sums of pair products and 
the Pearson product moment correlation coefficient. PROGM contains a brief 
review of the computational aspects of these topics for the student who 
needs to refresh his memory; the review is not an adequate replacement for 
prior statistics instruction. However, if the student knows how to inter- 
pret a computational formula for the Pearson correlation coefficient, then 
he will usually have the necessary statistical prerequisities. 

Ob.iectives 

The objective of PROGM is to provide enough instruction and experience in 
the use of TINT so that the student will be capable of using it for ele- 
mentary statistical computations. He must learn how to write correct TINT 
statements for accepting data, doing summations, expressing formulas, and 
communicating results, A correlation programming problem is used to test 
whether the student has achieved this capability, since it encompasses 
most of the programming techniques required in computation and data proces- 
sing for commonly \xsed statistical procedures, 

*See Appendix 5 for more details about PROGM and illustrations of its use. 

^<*TINT (Teletype INTerpreter) is a programming system for on-line use [12]. The 
user may type program statements while seated at a teletypewriter which commim- 
icates with a time-shared computer. He can call for Immediate execution of 
these statements or save his program by issuing commands from a teletype^^^:ite^. 






ittaittiiiiir 
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Content 



PROGM is divided into fifteen topics. (Appendix 5 discusses the content 
for each topic.) Briefly, the. concepts that are covered include:’ 

. item names, their declaration forms and meanings, 

. composition of a statement and role of the equal sign within it, 

. conditional e:q)ressions, both simple and compound, 

. sequence control through branch commands, 

. the construction and applicfition of loops, 

. arithmetic conventions, and 

. TINT command conventions. 

An orientation precedes the actual lesson material for those who signify a 

need for it, and programming exercises, are introduced within the lesson, 
increasing in frequency and complexity toward the end. The correlation 
problem is the final exercises. 

Styles Employed 

The pedagogic styles in FROGM are expository, tutorial, and exercise. An 
effort was made to minimize the expository material because of the inade- 
quacies of the teletype printer for displaying large amounts of text. 
Therefor^, typed tutorial dialo^es and TINT exercises dominate the instruc- 
tion. 

Normally, PR0C34 assumes the initiative during the dialogue with the student. 
Depending on the student's response to the question or message from PROGM, 
PLANIT selects the frame to be executed next. However, there are five 
exceptions to this. If the student types one of the following messages: 

. < — REVIEW 

. <— EXPLAIN 

. EXAMPLE 



TINT 



QUIT 



Bsaa&aaii 


















I 

i 

i 



\ 
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f’ 

I 



i 




in place of an "expected" response, he can seize the initiative temporarily. 
This permits him to review topics, to request explanations and examples of 
the use of TINT commands to access the TINT programming system (an abbre- 
viated version) for use in programming exercises, or to signify that he 
wishes to tenninate an instructional session. The student may return to 
the normal lesson sequence when his request has been satisfied, except for 
the request to terminate the session. (A more detailed discussion of these 
student lesson control features is contained in pages l67-l?2 of Appendix 5») 

Illustration 

The teletypewriter record sample in Figure 10 shows a student's first 
attempt to use the TINT language and interpreter in an exercise. The 
student usually makes his teletypewriter response following an asterisk 
when PLANIT is controlling the instructionel sequence. However, when the 
student is actually employing the TINT interpreter, he types his messages 
following the TINT signals: 

"*ENTER COMMAND," or 

"* 1 , 00 " 

where the latter designates a label for a line (the first in this case) of 
program code. 
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WOULD YOU LIKE TO DIGRESS FOR AWHILE AND ACTUALLY TRY THIS PROGRAM 
IN TINT (IT WILL MAINLY INVOLVE SOME EXTRA TYPING)? 

♦OK 



OK* YOU WILL NEED TO KNOW THREE TINT COMMANDS* •• 

? START 
? EXECUTE 
? READY 

TINT COMMANDS ARE ALL PREFACED WITH A QUESTION MARK (?)• YOU WILL 
RECEIVE A MESSAGE# ♦ENTER COMMAND* ENTER*** 7START* TINT WILL 
NUMBER THE LINES FOR YOU AS YOU TYPE THE PROGRAM* WHEN YOU HAVE THE 
PROGRAM TYPED AND TINT IS ASKING FOR ANOTHER LINE# TYPE*** ?EXECUTE* 
YOU WILL THEN BE OPERATING YOUR OWN PROGRAM* YOU MAY RUN IT AS OFTEN 
AS YOU WISH BY SIMPLY TYPING THE COMMAND# 7EXECUTE# AGAIN* 

YOU MUST RECOGNIZE THAT YOU WILL NOT BE OPERATING PLANIT THEN# BUT 
YOU WILL BE OPERATING TINT* WHEN YOU ARE READY TO RETURN TO PLANIT 
AGAIN# TYPE*** ? READY* 

THE FIRST PART OF YOUR SHEET SHOULD LOOK LIKE THISt 

♦ENTER COMMAND 
? START 

♦ 1*00 REAL NUMi 

♦ 2*00 READ NUMI 

♦ 3*00 IF NUM LS 01 

♦ 4*00 NUMa-NUMi 

♦ ,5*00 PRINT NUMI 

♦ 6*00 7EXECUTE 

NUM » 7 

I AM GOING TO GET TINT FOR YOU NOW* DON’T FORGET TO TYPE*** 7READY 
WHEN YOU WANT TO RETURN* THIS WILL TAKE A FEW SECONDS* STANDBY* 

NOTE; About five to fifteen seconds elapse here while the TINT interpreter 
is "loeuied into PLANIT" fSrom TSS disc memory and then the student begins to 
prepare a TINT program, TINT signals the student to begin with the message, 
"♦ENTER COMMAND." 



FIGURE 10. mom Excerpt (Sheet l) 



(Rrior to this excerpt the student has been shown the essential statements in 
>r a program which computes the absolute value of a number.) 







msmmmBsm 
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♦ENTER COMMAND 
? START 

# 

♦ 1.00 REAL NUMi 

♦ 2.00 READ NUMI 

♦ 3.00 IF NUM LS 0i 

♦ 4.00 NJUMe-NUMl 

♦ 5.00 PRINT 

♦ 6.00 ? EXECUTE 

NUM = ? 735 
♦.735000000E+003 
♦EXECUTION COMPLETE 



♦ ENTER COMMAND 
7EXECUTE 

NUM = ? -399 
+ .3 99000000E4>003 
♦EXECUTION COMPLETE 



♦ ENTER COMMAND 
? READY 



Note : With the command '’?READY" control over instruction is returned to 

PIANIT and normal dialogue resumes. 



YOU PROBABLY NOTICED A DIFFERENCE IN THE FORM USED TO PRINT YOUR 
NUMBER. IT WAS PRINTED IN SCIENTIFIC NOTATION. LATER I WILL SHOW 
YOU HOW TO MAKE IT PRINT IN OTHER FORMS. DID YOUR PROGRAM WORK AS YOU 
EXPECTED IT TO (OTHER THAN THE NUMBER FORMAT)? 

♦YES 

, FINE. YOU’RE A TINT PROGRAMMER ALREADY. 



YOU SAW LINE NUMBERS ATTACHED TO THE STATEMENTS IN A COMPUTER 
PROGRAM. THEY ARE NOT PART OF ANY STATEMENT AND HAVE NO FUNCTION IN 
THE OPERATION OF THE PROGRAM. THEY ARE USED FOR EDITING. WE WILL 
IGNORE THEM FOR NOW. 
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III. CAMPUS TRIALS 
A. DESCRIPTION OF TRIAL CONDITIONS 











Two field trials of lesson materials produced with PIANIT were condTicted. The 
i*irst took place during July I966 on the canpus of the University of Southern 
California (USC) where a teletypewriter station was Installed and linked by 
tA^^O^ to the TSS computer in SDC's Santa Monica facility. Seven under- 
graduate students, the entire smmier session enroUment in Psychology 2?4* 
participated in shaJcedown tests of INTRO, DESCRB, and i>ortlons of FROHL. The 
students, with the exception of one, who worked ^one, worked at the teletype- 
writer in pairs dtbring each of foyr instructional sessions; the sessions varied 
in duration from 40 mimeses to 1^ hours and occurred at one -week .intervals. 

An SDC project representative was always on hand to establish DATAPHONE communi- 
cations, load the required programs, and intercede when the students asked for 
assistance. The students who worked in pairs were allowed to consult with each 
other before deciding on a response to questions posed by the con^uter and 
alternated as typists, one student perfbxmlng for the first half and the other 
for the second half of a session. (The use of pairs of. students rather than 
individuals was not deliberate but necessary because of scheduling conflicts.) 
None of these students had any prior computer experience, and before the tests 
began they were lx;troduced to time-shared conputer systems and CAI in a one- 
hour lecture; they were also assured that their performa n ce in these test 
sessions would not affect course grades. The lessons were frequently revised 
by SDC authors after each test session to remove discovered deficiencies before 
the next session (usually 24 houTs later). Thus, the last student to "see" a 
particular lesson often worked with a much' improved version. No attempt was 
made to pre-test or post-test these students on any of the material covered in 
their CAI instruction. The object in these tests was to check out PLANIT (which 
had been released as an operational program for author use only six weeks before 
the tests began) and to remove "bugs" from the prepared lesson material. 

The second test series was conducted between Ma.T*f>h 2 7 eund May 31. 1967 * at 
San Feriftf uf tfo yAiiev State College (SFVSC), Nbrthi'ldge, California. The test 
conditions were similar to those in the USC trials except that the number of 



^Psychology 2?4 is a first course in statistics required for psychology 
majors b\xt also attended by other students, ^le students in these trials were 
juniors and seniors majoring in sociology, education and pre-dentistry, in 
addition to psychology. Dr. Ray Berger, who has taug^ this, course for several 
years , was the instructor and used the text by Guilford [6] . 
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students participating*^ 'iwas increased to l4, and all students worked individu- 
ally at the single teletypewriter installed on cairpus in Northridge, PIANIT 
was considerably improved and augnented in the interim between the two test 
periods making it possible to write and present more elaborate lessons such as 
EROGM. Each of the l4 students was scheduled for one hour of instruction at the 
teletypewriter per week for eight weeks, but only 75*?^ oi* the time when students 
were present was devoted to actual instruction.*** Again, an SDC representative 
was present to assist the student; a log was kept in which impressions and 
observations were recorded by the representative. An improved version of IHTRO 
was used to introduce these students to the use of the teletypewriter and PLANIT 
communication conventions and procedures. Then the students began con 5 >uter pro- 
gramming instruction via the lesson PROGM. There was no. attempt to measure any 
gain in knowledge through pre- and post-testing since this was a shakedown test 
of PROGM. (However, only two of the l4 students had any prior comput'er program- 
ming experience or training). PROGM, unlike the lessons DESORB and PROBl, was 
not designed to augment conventional classroom instruction or textbook readings. 

It represents an attempt by the SDC authors to provide a completely self-contained 
CAI sequence for on-line computer programming. 

These two tests of CAI provided the SDC staff with ample opportunities to observe 
both the problems and benefits that accompany CAI. The observations and impres- 
sions gathered by SDC monitors during these trial runs with PIANIT are discussed 
below from the standpoint of students, instructors, and authors of CAI lessons; 
the roles of instructor and author with respect to CAI lessons were assumed 
entirely by the project staff who report their own experiences in these roles. 

B. PROBLEMS ENCOUNTERED 
By the Student 

By far the most serious problems encountered by students during their use of 
PIANIT (and STAT) stemmed from failure to appreciate the meaning Of certain mes- 
sages that would appear on the teletypewriter. For example, .some students sent 
their messages to the time-shared system executive program (TSS Exec) rather 



**These students were volunteers enrolled in Professor Robert Dear’s section 
of Psychology 320, Statistical Methods in Psychology, a first course in statis- 
tics for undergraduates majoring in psychology. Dr. Dear used Hoel [8] as the 
pourse textbook. Satisfactory performance on a qualifying examination including 
algebra, descriptive statistics, and elementary uses of the normal probability 
distribution was a condition for enrollment in Psychology 320. 

***Students were actually available for CAI for 97 hours during the eight-week 
period. Of these hours, 15 were lost due to problems involving software, hard- 
\rare components of the computer system, or the DATAPHONE communications link and 
an additional eight hours could not be used because the required lesson material 
was not ready. 



I 









30 October 1967 TM-29lVlOO/00 

than to PIAHIT (or STAT) by inadvertently typing the exclamation point ' ! ’ 
(instead of 1), as the initial character in a numerical expression. In these 
cases, instead of an expected numerical reply from the computer the student 
often saw *$?', a message from TSS Exec signifying that the student's , 
message could not he interpreted. When the student repeated his messap, typed 
I correctly this time, he failed to realize he was still communicating with TSS 
i Exec, not with StAT or PIANIT, and received the same reply from the puzzled 

? computer *$?'. (in order to reestablish communication with STAT or PLANIT the 

student ■ would have had to' preface his repeated message with the double qu(Dtes, 

\ " symbol. Even those students who were aware of this procedure oi^en fa^ed 

[ to employ it because they did not j^ealize the nature of their difficulty.) SDC 

^ monitors interceded in such cases so that the student could continue with his 

instruction. 



i A communication problem of a different soft arose for one student who typed 
^ 'SQ5T(5)' instead of "SQiRT(5)'’ while communicating with PLANIT's CAII3 mode. 

He wanted to obtain the numerical value of the square root of 5 but the computer 
i replied *EHTER VALUES (COMMAS BETWEEN) FOR; SQ5,T. Surprised by this unexpected 
reply the student inspected his original message and noticed that he had typed 
J the numeral 5 in place of R; he then retyped his request correctly. The computer 

r still did not reply with the desired numerical result, but requested a value 

for 'T*. An SIXJ monitor had to intercede, to explain that the student's original 
message was being interpreted as a request to evaluate the triple product (Df' an 
|"i item called "SQ5* with an item called 'T' and the number '5'ji and was calling 
for information needed for this purpose. The monitor a.lso ejqplained how to 
"cancel" the effect of the original mistyped message to CAI/:,, 

• 

The frequent User of a time-shared system and programs operaliing within it 
r learns from experience and training to cope with communication problems like 
? these and others. Many of the students' communications difficulties could be 
anticipated by the project staff, and were, but it was decided not to expend 
1 more than an hour or tiro of each student's limited time to instruct him in 

communication conventions and procedures. In other circumstances, particularly 
\ where the student is to make fuller use of the CM£ mode, he should have about 
I five hours of introductory instruction including many CAIU exercises. 



^ Many students would have enjoyed a greater measure of control over the instruc- 
[ tional sequences. For example they could not effect control in most lesson 
I presentations to review a topic already' encountered. (This review feature was 

[ included only in the lesson FROGM.) Also, through careless typing of a response, 

the student might set off a remedial chain of instruction that he did not require 
and could not stop. In other cases he could not interrupt such remedial 
sequences, when they were longer than necessary for his individual recpiirements . 



Improved preparatory instruction in CAI communication conventions and procedures, 
more interactive experience with TSS, redesign of the teletypewriter keyboard, 
more cleverness in the design of lessons, and more detailed feedback messages 
from the computer cannot completely eliminate these problems, but will markedly 
reduce their frequency of occurrence. 
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2, By the Instructor ^ 

The regular instructors of the students who participated in the field tests 
remained almost entirely ignorant of what their students were doing at the 
teletypewriter stations. Many of them. could not gain access to the teletype- 
writers without displacing one of their students. They were loathe to do this. 
Some instructors did try the lesson material in the evenings when the teletype- 
writer was fl*ee, but could not spare as many hours as would be required to 
fully explore a lesson, especially not lengthy lessons, like PROGM, Documenta- 
tion of the CAI instructional sequence, shoim in Appendices ^ and 5 for DESCRB 
and PROGM was not available during the field trials. Such descriptions of CAI 
lessons are essential for the instructor who may wish to "browse" through a 
lesson, as he mi^t a textbook, before deciding whether to use it for his 
classes. Also, some of the lessons "advise" the student to seek help outside 
the coir5)uter when he has failed to master a part of the lesson. Instructors 
should be prepared for such visits from students, and the documentation of 
lessons would be essential for this purpose as well as others. In addition, 
in future trials (or in actual CAI operations) instructors should be free of 
a portion of their regular teaching chores, to have time to becoine at least as 
well oriented as their students to CAI. 

3. SL the Lesson Authors 

The preparation of CAI lesson material, while greatly facilitated by PLANIT, 
proved to be a time-consuming task, particularly for the tutorial type of dia- 
logue. A good student could complete a lesson like PROBl, which is almost 
entirely tutorial, in an hour. The author(s) of PROBl invested approximately 
200 hours in its preparation. Much of this time is consumed in building the 
sets of anticipated student answers, to the questions posed by the author, and 
planning the various paths throu^ the lesson frames as a function of the 
students* answers. If a tutorial dialogue is to provide truly individualized 
instruction for a heterogeneous class (with respect to levels of ability and 
preparation in prerequisites), 200 hours is probably only a lower bound for 
the time an author will, spend building a "one-hour" tutorial. It Is clear that 
the tutorial form of CAI represents a heavy investment of skilled individuals ' 
time and should be attenpted only for fundamental, troublesome topics and 
lessons where a large number of students can profit from the instruction. 

By contrast, the CAI sequences for numerical exposition of statistical proper- 
ties (e.g. , the properties of the sample mean in DESCRB, see page 33 ) or for 
statistical laboratory exercises (as in STAT) can be prepared in far less time; 
project e:>perience indicates that some 3^ hours of author time would be suffi- 
cient to prepare material of this type that would occupy a student for one hour. 

C. APPAREM' BENEFITS FOR THE STUDENT 

1, The student pays attention . Throughout the PLANIT field trials in sessions 
at the teletypewriter that usually lasted for an hour, the student kept his 
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attention fixed on the learning task. This is remarkable considering the primi- 
tive conditions that the student faced, e.g. , occasional TSS failure, a noisy 
teletypewriter. (No doubt the novelty of CAI was partially responsible for this 
phenomenon, but the same effect was noticed in the longer, three-hour sessions, 
when students used the STAT program. There, this high degree of student atten- 
■^iveness was still visible even during the last of five three— hour sessions.*) 

In addition, the students all began their work promptly with the first computer- 
generated message and stayed with their learning task until the lesson was 
completed or the SBC monitor interceded to remind them of a class they had to 
attend. (Some observers of the CAI scene have commented on the negative aspects 
of this phenomenon, e.g., the ’'transfixed' .student may lose contact with his 
fellow students, the library or professors.) There is little question that 
some of the students who- participated in these trials would have' difficulty 
maintaining equivalent attentiveness and concentration with the same subject 
matter in other learning situations, e.g., while reading a textbook or attend- 
ing a lecture. 

2. The student aiJpreciates •privacy and feels "freer to fail ." In CAI, the 
student attempts to answer questions or to work' exercises presented to him by 
the -computer ^without the reluctance and hesitancy he often exhibits in the 
conventional clas'kirocm setting. He has no fears that he is wasting class time 
or that his peers or the instructor are "grading" him when he replies to a 
computer-presented question, though he may be less than sure his answer is 
correct. This is not to say the student finds "being wrong" a pleasant exper- 
ience in CAI, but it is apparently less uncomfortable for him and less threat- 
ening than in the classroom. This advantage of CAI was noticed for some students 
with apparent low levels of self-confidence who were observed by an SDC monitor 
both in the classroom and during CAI field tests. 

3. The student get^tp use*mor e varied techniques . The calculation capability 
in STAT or in PLANIT*s CALC mode makes it possible for students in beginning 
statistics courses to us.e a greater variety of techniques. For example, non- 
parametric techniques are often preferable** to such parametric "work horses ' 
as Student’s-! Test for comparing two populations or the effect of two treat- 
ments. However, almost all non-parametric tests require that the sample data 
be ranked according to magnitude before the test criterion can be computed. 

The task of ranking saiiple data even in samples of quite modest size, say 20 to 
30 observations, is time consuming and discouraging (particularly when much of 
the data lies in a narrow interval). The ranking function available in 



*However, it should be noted that these UCLA graduate students who partici- 
pated in STAT tests were paid volunteers. 

**Hodges and Lehmann recommend that beginning students be taught the non- 
parametric Wilcoxon f sometimes called Mann-Whitney) test in place of Student ’s-T 
Test. See p. VIII in the Preface of CtL 
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in PLANIT«s CALC mode provided some students fthose 
that tested 3TAT) their initial experience with the actual use of non -parametric 
technique for samples of realistic size. 



Concepts that are "difficult** for beginning students can be demonstrate d 
nurorically. There are interesting statistical concepts and properties that 
can be demonstrated numerically for beginning, non-mathematically oriented 
students of statistics where a mathematical demonstration or proof would be 
inappropriate or easily forgotten. For example, with DESCRB the students 
participated in numerical demonstrations of two properties of the sample mean: 
that sample deviations sum to zero and the sum of these squared deviations is 
minimized, when deviations are measured from the sample mean. (The student was 
allowed to choose a number (s) within a restricted range and the two sums were 
automatically computed by PIANTT with the student»s number(s) replacing the 
sample mean. The student was then asked to compare- these results with those of 
preceding computations where the sanple mean was used.) Many other concepts 
could have received such numerical treatment had there been more time for the 
SDC authors (or faculty at USC or SFVSC) to prepare the required CAI lesson 
Weil as auxiliary notes* which would explain and anplifV the 
numerical results for the student. 



CAI can play a use ful supplementary role for conventional instkictlon. Tt 
was assumed that students would be introduced to such topics as elementary 
probability or descriptive statistics in the classroom and in text readings.* 
The tutorial instruction provided by PROBl and DESCRB was designed to remove 
deficiencies in the student’s understanding of this material or to revisit 
certain topics, rather hastily covered in class, in a more leisurely fashion. 
There was evidence that this supplementary role w^s welcomed by both students 
and instructors. This was especially true for PROBl, which proved to be very 
popular with students in the PLAIOT field trials. Yet PROBl can hardly be 
considered a "finished" lesson. It needs to be polished and extended. We 
believe its popularity stems from the need for supplementary probability 
instruction for which too little time** (two to four lectures, depending on the 
instructor) can be spared in most beginning courses in statistics. CAT, 
properly designed and tested, could offer the student such instruction in 
varying amounts according to his needs. 



*There is little point in using CAI merely to have the teletypewriter present 
the students with large amounts of Introductory and expository text or the 
recorded form of a professor’s lecture. 



*^here Is a teMency to introduce a greater amount and more modern treatment 
of probability into the beginning statistics course. This is visible in the 
textbooks that were used by these students, Guilford [6] at USC, and Hoel [8] 
at SFVSC; earlier editions of these texts devoted fewer pages to probability.. 
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6. Maggiet effect . The single teletypewriter Stations that were installed at 
use and 'SFVSC drew students who were not participating in the PIANIT lesson ' 
trials. Some students were merely curious and wished to observe a "computerized 
tutor" in action. Other students who had some programming experience, were 
eager to use the on-line programming capability that was available throu^ time- 
sharing. At SFVSC several such students "mysteriously" appeared each day at 
the close of PLAKIT trials to inquire whether they could interact with TSS. 

They were given a TINT programming manual [12] , a few hints about "logging in", 
and permission to use TSS during low-load evening periods. They made rapid 
progress and, on their own, worked throu^ many of the exercises provided in 
the manual. 



D. INSTRUCTOR AND STUDENT ATTITUDES 



1, The Student *s Attitude 




No systematic attempt was made to measure the students* attitude at either 
campus during PLANIT field trial-s. However, it is quite clear that when the^ 
computer has something to say that is of interest to the student, he i^s willing 
and eager to -pay attention. The students came to the trials on their own time 
without compensation, other than that provided by their CAI experience, and 
their attendance record was excellent. Often their experience was a frustrat- 
ing one (about 1 % of the time was lost during these test sessions due to some 
failure of TSS or the communication link between the college and the computer), 
I but the use students returned for further CAI tests with no exceptions. 

At SFVSC there was a falling off in attendance as the final examination period 
approached. Prior to that, only three of sixteen student volunteers failed to 
appear regularly#* The students were too polite to complain to their SDC 
monitors but did complain to their instructors and other "outsiders" about 
frustrations stemming from the lack of reliability in remote TSS operations, 
the too rapid pace of the lesson PROGM, and too little orientation to TSS 
operations. 



2 . The Instructor’s Attitude 



Both at use and SFVSC a cordial reception was given to CAI by faculty members. 
Dr. Ray Berger, USC instructor of the class that provided students for the first 
PLANIT tests, expressed a desire to use STAT and any other available PLANIT 
lesson material with his futxire classes. One of his colleagues. Dr. Daniel 
Davis, expressed similar interest in the fall semester following the USC trials. 
(Some of Dr. Davis' students used an improved version of PROBl before the tele- 
typewriter station at USC was removed in September 1966j both Dr. Davis and 
these students expressed strong interest in additional CAI material for prob- 
ability and statistics which, unfortunately, was not available.) 



*0f these three students, two dropped out early because of an accident and 
family illness, respectively. The third student had a very spotty record of 
attendance at the trials (and in his regular statistics class). 
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At SFVSC, Dr. Richard Docter, chairman of the Psychology Department, and three 
of his colleagues, Professors Smith, O'Connell and Dear, were most interested 
.vn the catalysis that CAI might provide for curriculum innovatio'h and reorgani- 
sation. For example. Dr. Dear saw advantages that could accrue to his students 
in a course on design and analysis of experiments from an on-line matrix arith- 
metic capability. (Such a capability could be provided through expansion of 
PIANIT's CALC mode or through special subroutines that might be written and 
executed with TIIJT. ) Dr. O'Connell was interested in exploring the opportunities 
in CAI for closer ties between courses iri experimental psychology and the design 
and analysis of experiments course. A conputer-based statistics laboratory 
could serve both areas of instruction.* 

In summary, the faculty members who were encountered during these student trials 
were quite willing to learn about CAI and to experiment with it as authors and 
instructors. However, the resources of the project were inadequate and insuffi- 
cient (also the professors did not have enough time when they were free from 
regular duties during the project) to give them opportunities for .either activity. 
The discussion that follows includes recommendations for greather involvement of 
teachers in the development and application of CAI. 

IV. CONCmSIONS AM) RECOMMEND/VTIONS 

This study provided the staff with valuable experience of several types: design 

and implementation of PIANIT; the use of a time-sharing system (TSS), together 
with PIANIT , to build and present CAI lessons for a variety of topics in varied 
styles; and observation of some 150 hours of student interaction with these 
lessons. This experience is translated in this section into conclusions and 
recommendations for (l) development of a less costly (to operate) PIANIT and its 
distribution to colleges and universities, and (2) given such distribution, 
appropriate and feasible applications of CAI in the statistics instruction of 
undergraduates majoring in the social sciences. 

A. DISTRIBUTION OF PIANIT TO COLLEGES AND UNIVERSITIES 

PIANIT proved to be a most valuable assistant on this project from the time it 
was released for use in the SDC TSS. In the hands of experienced computer 
programmers, it cut the programming time required to generate lessons at least 
by one -half over comparable prograimning with a general-purpose language such as 
JOVIAL. It permitted temporary and part-time assistants, who had no programming 
skill, to generate and edit lesson material within two weeks of their introduction 
to PIANIT. The enthusiasm for this CAI author language was by no means restricted 



*Discussion of these ideas by SDC staff and these SFVSC faculty members resulted 
in an informal proposal, "The Computer and Innovation in the Undergraduate 
Curriculum," which has been submitted to the Office of Computer Activities, 
National Science Foundation. 
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to the project staff. Numerous requests came from other works in GAI (e.g. , at 
the University of Michigan, at the Irvine campus of the University of California, 
etc. ) for access to PIANTT which could not' be provided. The SDC TSS was ali*eady 
oversubscribed and ’’shares" were not available even for requestors who could 
afford the $10 per hour SDC TSS charge. Other requestors could not tolerate 
this cost were shares available. Both barriers can be overcame for a large 
class of users through reprogramming of PIANIT to operate with relatively in- 
e^q»ensive confuting equipment which is currently or soon to be installed on 
many campuses. Preliminary design figures indicate that a medium-small central 
processor (e.g. , IBM 360 *Aqh) could be used to operate a redesigned PIANIT quite 
satisfactorily for 50 to 100 users,* at an hourly operating cost of one to two 
dollars per teletype station including the teletype rental fees. The redesign 
of PIANIT for such equipment (with large disc memory) would result in further 
economies and convenience. For example, the program could be recast into modules 
permitting students to en5>loy a reduced moduie containing only the CALC (on-line 
computation) and EX (lesson presentation) modes. Lesson authors would use a 
larger modiile (requiring more of core memory) incorporating all of the modes, 
as in the currently existing PIANIT, including lesson building and editing as 
well as EX and CALC. 

It .^s therefore recommended that such a redesign and reprogramming effort be 
supported by the Foimdation to provide a large number of colleges and universities 
with what might be tenoed an instructors' con5>uter utility.* 

f B. APPROPRIATE AND FEASIBLE GAI FOR STATISTICS 

We believe that computer-student dialogues for the laboratory type of instruction 
and the numerical demonstration of concepts represent the most appropriate forms 
of GAI for statistics at this time. It is feasible to provide only the more 
routine aspects of tutorial assistance with GAI (at present and probably for many 
years to come); a restricted use of tutorial dialogue is therefore recommended. 

1. The Computer-Based Statistics Laboratory 

There is little question that the student will enjoy the profit from the 
computational convenience of such a laboratory and the immediate feedback about 
the correctness of his submitted answers. The student can be introduced to the 
teletype and PIANIT calculation and communication procedures in approximately 
the same amount of time currently devoted to his instruction in the use of desk 
calculators. The instructor would be spared the drudgery of providing data for 
exercises, computing correct answers, and keeping records of student j,jx)gress 
and perfoiroance. The cost of developing such instruction and its maintenance 



*SDC Proposal 5^-195, Instructors' Computer Utility , discusses the design and 
implementation of this utility, and will be submitted to the Office of Computer 
Activities, National Science Foundation, in December I967. 
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is modest. We estimate that a subject matter expert, working full-time, could 
build a statistics laboratory instructional seq.uence, e.g., an improved version 
of STAT without the disadvantages discussed earlier in this report on pages 15-17 
with PIANIT in three to six months j this would provide a full semester of 
laboratory work on the basis of one or two hours at the teletype per student 
per week for I 6 weeks. The cost of operating this "laboratory," at the esti- 
mated rate of one or two dollars per teletype hour, could be recouped from 
student fees quite comparable to those charged for the use of college chemistry- 
laboratories . 

2. Numerical Exposition of Statistical Concepts 










Much has been written about the benefits to be derived from Monte Carlo 
(sampling) experiments in teaching statistics, especially to students whose 
mathematical training is limited. Virtually e-very introductory text suggests 
that the student toss dice or coins and record the frequencies he obser-ves for 
^rious outcomes. The computer not only offers the advantages of. faster 
tossing, automatic recording and tallying of results, virtually painless 
calculation of theoretical frequencies (probabilities) for con 5 >arison with 
empirical results, but perhaps most important of all, it can easily "produce" 
coins whose probabilities for coming up heads can be any desired number from 
zero to one. In other words, the student (or his instructor) can -vary parameters 
(e.g., sample size, population mean) and explore the effect of such -variations 
on both the samples that are generated and theoretical probability distribu- 
tions. . It is ironic that the very Impact that such numerical demonstrations 
of probabJ.iistic (and statistical) concepts would ha-ve on normal classroom 
instruction is what pre-irented, to a great extent, the experimentation with 
such GAI sequences in this project. The student must be prepared in advance 
for such demonstrations through specially prepared "notes" or texts and in 
class dlschssions if he is to piofit fully for them. There was not sufficient 
time and personnel to Integrate the GAI experiments with the classroom instruc- 
tion of the students Mho participated in the PIANIT lesson field trials. It is 
interesting to no-te that the exaii 5 )le of a numerical demonstration for correlation 
shown on page 25 was quite instructi-ve e-ven to several experienced users of 
statistics at SDC. It is this type of GAI that will most likely produce signifi- 
cant increases in the student *s understanding of concepts and in his ability to 
think statistically. Fortunately, as in the case of the laboratory exercises, 
the preparation of such expository demonstrations is not very time-consuming 
for the knowledgeablfe (in subjecjt matter) GAI author. A demonstration that 
could occupy a student for 10 or 15 minutes can be constructed by a "non- 
programmer" statistician (e.g., one of the authors of this report, J. Rosenbaum) 
in four or five hours, from initial concept to "debugged" lesson. 

It is therefore recommended that studies leading to the de-velopment of both 
laboratory exercise and numerical demonstration sequences be supported by the 
Foundation. This activity can and should proceed concurrently with the 
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redevelopiment of PIAIO!r.^ The PIANIT language specifications are firm so that 
any lesson material prepared and tested using the current SDC TSS facility 
vould be executable with the redeveloped PIANIT system as veil. Such lesson 
materials vould then be ready ^or use In the various colleges and universities 
vhen the redeveloped PIANIT Is made available to them. Not only would these 
lessons be useful for the Instruction of students^ but they would serve to 
exemplify lesson-building techniques and PIANIT 's capabilities for the faculties 
at these Institutions. 




3» Restricted Tutorial Instruction 

I 

Perhaps the most valuable feature of PIANIT (as a language fOr specification 
I of CAI lessons) Is the power It affords the lesson designer for prescription 

I of communication between student and computer. This feature Is exploited In 

I several ways In preparing and executing lessons of the two types discussed 

I above. In demonstrations and laboratory exercises^ much of the content of 

I messages sent to the student Is numerlccQ. and computer-generated from speclfl- 
I cations (e.g.^ sample size and poptilatlon parameters for pseudo-random data^ 

I the definition of a mathematical function, etc.) stored by the lesson desl^r 
I In lesson frames, or supplied by the student from his- teletype, or combinations 

I of both. The pedagogic value of such lessons Is considerably enhanced If pre- 

I stored verbal messages, designed to provide tutorial services, are also presented 

I to the student from time to time. The student can then be Interrogated by the 

px machine to deteimlne If he wishes to continue with a demonstration, \diether he 
. ) Is ready to go on to an exercise involving a concept just demonstrated, or 
I whether he wishes to review some parts of available lesson material, and de- 

I pending on his response, appropriate computer behavior can ensue; the student 

I can be enlisted Into guided active participation In a numerical demonstration 
I . by ashing him to supply or to vary some required parameter values; the student 

I can seize the initiative in his dialogue with the computer by typing a request 

for help with an exercise and he can be furnished hints on how to proceed toward 
i a correct solution; the student *s attention can be directed to some subtleties 

I in an exercise or demonstration after he has had sufficient exposure to the 

I content therein. These are all exanples of tutorial duties performed by an 

[ Instructor when he Is In a position (all too seldom In most colleges and unl- 

[ versltles) to Interact with the Indl-^dual student In the educational process. 

The deeper forms of tutorial assisteuice, however, require "intelligent beha-vlor" 
that machines cannot yet provide (e.g. , inspection of a series of calculations 
to determine where and why the student Is going astray) or that can be only 
rudely approximated at great expense*** (dialogue between the student and the 
conputer to detect and explain a non sequitur in his faulty chain of reasoning. 



*An informal proposal, "The Computer and Innovation in the Undergraduate 
Curriculum," describes such an activity and has been submitted to the National 
Science Foundation. 




**See page 47, for a discussion of the lesson author effort required to 
produce a tutorial CAI lesson, PROBl. 
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We therefore recommend that only the more routine aspects of tutorial assistance 
be atten^ted vith GAI, and mainly in lessons that are expository or of the 
laboratory exercise type. 

V. PROJECT STAFF , 

Dr. Harry F* Silberman, Maniager, Education and Training Staff, was Principal 
Investigator for NSF Grant GY- 3 T 1 and supervised the full time effort of these 
staff members for the entire term of the study: 

Mr. Joseph Rosenbaum, Project. Director 

Mr. Samuel L. Feingold, Senior Programming Analyst 

Dr. Charles H. Frye, Human Factors Scientist 



During the second year of the project, they were assisted by personnel on loan 
from the Defense Systems Division of the Corporation: 




I 

f 

I 



t 

I 

t 

I 



Mr. Alfred K. Butler, Human Factors Scientist 
Mr# Fred D. Bennik, Human Factors Scientist 

Two student associates, Mr. John C. Hawkins, University of Utah, and 
Mr. Bobby R. Brown, Pennsylvania State University, worked full time on the 
study during the summer of I966 in residence ijn Santa Monica. 

The project employed two paid consultants: 

Wilfrid J. Dixon, Professor of Biostatistics and Professor of 
Preventive Medicine, University of California (Los Angeles) 

Dr. Frank B. Baker, Department of Educational Psychology and 
Wisconsin Research and Development Center for Cognitive 
Learning, The University of Wisconsin, Madison, Wisconsin. 

VI. PRESENTATIONS, PUBLICATIONS, ARP PROJECT DOCUMENTATION 

A. PRESENTATIONS 

0 

The PIANIT system was described and demonstrated for National Science Foundation 
representatives on two occasions: 

. 18 October I966, Dr. Lavon Richardson, at System Development Corporation, 

Falls Church, Virginia 

. 1 March 196 T> Drs. Glen Ingram and Arthijp: Melmed, at System Development 

Corporation, Santa Monica, California# 

Similar presentations were made to various professional groups euid organizations. 
Most notable are; 
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B. 



, 8 August 1966, Sumner Study Gioup on GAI, U. S. Naval Academy, 

Annapolis, Maryland. 

• 18-19 August 1966, Amferican Statistical Association (126th 
annual meeting), Los Angeles, California 

16-17 August 1966, EDUCOM (Task Force on Educational Systems 
and. Technology)* University of Colorado, Boulder, Colorado 

. 26-27 September I966, Office of Naval Research GAI Interest 

Group (3rd. semiannual meeting). System Development Coi^)oratlon, 

Santa Monica, California 

• 30-31 March I967, Workshop on GAI Languages, Learning Research 

nr\A Development Center, University of Pittsburgh, Pittsburgh, 
Pennsylvania » 

PUBLICATIONS 

. Felngold., S. L., "PIANIT— A Flexible Language Designed, for 
Computer— Human Interaction, * At|JlJ^^onference_Proceeding8 , 

Volume 31. Fall Joint Computer Conference, November 14-16, 

Anaheim, California* Washington, D* C*: Thompson Books* 

1967. PP* 5^5-552* 

, Rosenbaum, J* "Dialogues for Elementary Statistics Instruction 
via Coraputer," Computer Science and. Statistics; Mode m Instrument 
of Tec^^^gal and Manii.gement Progress , A* F* Goodman and. N* R* Mann, 
editors* New York, n 7 Y* : Academic Press (scheduled for publication 

late 19^)* 



I C* PROJECT DOCUMEIWJATION 

i • Frye, C* H* and Rosenbaum, J* Student’s Guide to STAT* 

I SDC document IM-29IO/OOO/OO* March 31^ 19^6* 172 pp* 

i * Frye, C* H* and Felngold, S* L* User’s Guide to PIANIT: 

Programming lANg uage for Jiteractlve Teaching* SDC document 
I ^-3055/000/017 October 17, 1966* ^ PP* 

! In addition, three progress reports were submitted to the National Science 

\ Foundation during the project: 

I 

‘ • H* F* Silbeiman and J* Rosehbaum*’ "Semiannual Progress Report, 

I Computer-Based Instruction in Statistical Inference, 1 A^ll 

i ^ ^ TM-291J4-/001/00, System Development Corporation, May 2, 1966* 
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H, F, Sllberman and J, Rosenbaum, "Semiannual Progress Report, 
COTputer-Based Instruction in Statistical Inference, 8 September 
1966, TM-2914/002/00, System Development Corporation, 

September 19, I966, 



. H. P, Sllberman, "Semiannual Progress Report, CoE5>uter-Based 
Instaructlon in Statistical Inference, I3 March 1967," 

TM- 2914/003/00, System Development Corporation, March 13, 1967, 
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APPENDIX 1 

* 

THE SDC TIME-SHARING SYSTEM (TSS): 
EQUIPMErW I-TST AND CONFIGURATION 
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TSS BQUIPMEIW 



I 

t 

k 

I 



I 






COMPONENT 



number capacity /speed total 



Main Core Memory 

. Cycle time 2.5 ^sec. 

. Ii8-bit word 

In put Core Memory (Buffer ) 

. Cycle time 2.5 f/sec. 

Drum 

. Access time 11.5 ms, 

. Word transfer rate 2.75yUsec. 

Disc File 

. Access time 225 ms. 

. Word transfer rate 12 jjisec. 

Tape Drives (729-IV ) 

Card Reader (71^ ) 

Card Punch 

Typewriter 



AN/FSQ-32 COMPUTER 

1+ l6,381< words 

1 i 6,38L words 

5 139, 26L words 

2 U,19L,30L words 

11 112 1/2 ips 

1 250 cpm 

1 100 cpm 



2 100 wpni 

ASSOCIATED CCWPUTERS (ON/ OFF- LINE) 



65,536 words 

16,38L words 
o9b,320 words 

8,388,608 words 



PDP-1 

. Shares input core memory of Q-32 
. Cycle time 5/Xsec. 

. 18-bit word main core memory 



LK words 



32K words 
UK words 



ll*01-D 

. Core memory 
. Printer 

. Tape drives (729-IV) 

. Card reader (Uptime) 

I/O 



1 UK char. char. 

1 600 1pm 

2 112 1/2 ips 

1 850 cpm 

DEVICES 



Teletypes and Typewriters 
. Model 33 Teletypes 
. TWX data sets (remote users) 
. Soroban typewriters 
. Telex data sets 
. Data-Phone sets 
. IBM 1051-1052 . 

. Communications testboard 



3U 

6 

3 

1 

6 

1 

1 



100 wpm 
100 wpm 
90 wpm 
100 wpm 
100 wpm 
150 wpm 



Display Conaoles 

. Light pens , 

. Vector-generator capability 
. Graphic tablet 
. Keyboard 



6 2K char. max. 

(per console) 

1 5K points /sec. 

2 100 wpm 
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TSg CONFIC3URATION 



25-TTY 
5- TWX 

4-OATAfHONE 
1-TCLBX 
4-LEASEO LINE 



l-DATAfMONE 
EOR 1060 



2-TYFEWIITE* 



2-SPARE5- 

RESERVEO 



I-IROAPIANO 

COMfUTER- 

TO-COMfUTER 



40 

COMMUNICATION 

CHANNELS 



I/O 
TYPEWRITM 



FIX 
TYPEWRITER 



n TAPES 







lUPFER 


POP-1 




MB\AORv 



Q-32 

CPU 




I 

w. 







PRINT 


CARO 

READER 










DISK 

CONTROL 



HI 



CARD 

READER 




/ 

CARD 

PUNCH 








0 . 





“d 



DRUM 



DRUM 






DISK 



*< 



C, DRUM 
DRUM 



Tj 



HI DRUM ) 



DISPLAY 

CONTROL 




DISPLAY 

SCOPES 
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APPENDIX 2 

STAT OPTIONS, COMPUTATION CONVENTIONS, 
AND EXAMPIE OF STUDENT’S WORK 
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Student *s Reference Sheet for STAT-OPTIONS 
OPTION=? 



DRAW SAMPIE 



CALCrUIATION 



HELP 



1. SAMPLE data 

2. SUMS 

3 . Sums of SQUARES 
1+. Sum of PRODUCTS 

5 . Sum of DIFFERENCES 

6 . Sum of SQUARED DIFFERENCES 

7 . Sums of Nth POWERS 

12. CALCUIATION ASSISTANCE program 

Legal symbols: Sj SSJ SCP SMD SSD RX Fn mCn 

^ / ( ) [] 

9 . ANSWER to most recently^ MISSED QUESTION (Use as last resort) 

10. HELP, OPTIONS 21 to 66 

11. STEPS In SOLUTION 



YOUR ANSWERS 
BEGIN LIBRARY 



ESTIMATES 



8. Student RESPONSE and EVALUATION 

21. MEAN 

22. ' BIASED VARIANCE and standard deviation 

23 . UNBD^ED VARIANCE and standard deviation... 

2k. STANDARD ERROR of the MEAN 

25 . POOIED STAND. ERROR, for differ, of sample 

means 

26 . MEAN of DIFFERENCE scores 

27 . BIASED VARIANCE of DIFFERENCES 

28 . UNBIASED VARIANCE of DIFFERENCES 



P.I 6 I* 

P. 177-8 
P. 207 
P. 202 

P. 320 
P. 335 
P. 335 
P. 335 



SAMPIE 
STATISTICS 
BASED ON THE 
T-DISTRIBUTION 



31 . CONFIDENCE LIMITS for MEAN P. 312 

32 .. CONFIDENCE LIMITS for DIFFERENCE of MEANS P. 321 

33 . CONF. LIM. for DIFF. of MEANS, CORREIATED case.... P. 33*+-5 

34 . Criterion for testing that RHO (correlation 

• coefficient) equals zero P. 533 

35 . T-statlstlc for HYPOTH. TEST of MEAN P. 3H 

36 . T-statlstlc for HYPOTH. TEST OF DIFFER, of MEANS.. P. 317 

37 . T-statlstlc, TEST of DIFF. of MEANS, CORRELATED 

case P* 33^-5 



NOTE: Always wait for =? before typing a message. 



*These are page references to the textbook. Statistics for Psychologists by 
William L. Hays, Holt, Rinehart and Winston, New York, 1963 • 
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OFTION«? (continued) 



U2. 

NON-PARAMEJPRIC kk. 





»+5 


STATISTICS 


51 


BASED ON 


52 


CHI-SQUARE 


53 


DISTRIBUTION 


5^^ 




55 




56 


DEPENDENCE 

MEASURES 


57 




58 




59 




60 




61 




62 


REGRESSION 


63 




64 




65 


LIBRARY ENDS 


66 




13 




14 


PROBABILITY 

DISTRIBUTIONS 


15 




16 


TO TERMINATE 


20 



MANN-WHITNEY TWO GROUP SIGNIF. probability P. 633 

WILCOXON PAIRED OBSERVATION SIGNIF. probability...'. P. 635 

SPEARMAN RANK CORREIATION coefficient P. 6U3 

FISHER EXACT TEST P. 598 

GOODNESS-OF-FIT test statistic. P.. 586 

CONFIDENCE LIMITS for VARIANCE P. 3^5 

CHI-SQUARE test of INDEPENDENCE P. 589 

CONTINGENCY coefficient ‘ P. 606 

PRODUCT MOMENT CORRELATION coefficient P. 505 

Criterion for testing that RHO (correlation 

coefficient) equals zero (same as OPTION 3^)«»*«» P* 533 

T-statlstlc for CORRELATION TEST P. 529 

PHI-COEFFICIENT P. 60h 

SPEARMAN RANK CORREIATION P. 6U3 

T-statlstlc for RANK CORRELATION test (approx.) P. 6U6 

X on Y Slope, INTERCEPT and S.E. of prediction P. 50^“5 

Y on X Sloi>e, INTERCEPT and S.E. of prediction P. 50^-5 

X on Y S.E. of BETA and T-value for BETA P. 521 

Y on X S.E. of BE7TA and T-value for BETA P. 521 

X on Y Prediction and CONFIDENCE INTERVAL. .P.504-5, P.522 

Y on X Prediction and CONFIDENCE INTERVAL. .P.504-5, P.522 



BINOMIAL, I ^^P^(1-P)^"S 




MANN-WHITNEY 
WILCOXON paired 
observation 



level of significance for specified 
minimum rank sum and total number of 
ranks (l.e., sample size) 



LESSON TERMINATION, records and continuation code 



NOTE: Strike CARRIAGE RETURN button to enter typed messages Into the 

computer. To cancel a complete message, strike " (upper case 2) 
before striking the CARRIAGE RETURN. Strike the RUBOUT key to 
eliminate the last character you have typed; continuing to 
strike the RUBOUT key to eliminate the preceding characters, 
one at a time. 



([ ^ 



















wpi.w 



L'jjpiu* i!,a f t»yy • . .. 



30 October I967 



68 



TM-2914/100/00 



II jT 

Conventions for OPTION 22 , CALCUIATION ASSIE 7 TANCE 

The following symbols may be employed In OPTION 12 to compose expressions or 
statements for numerical evaluation. The expressions must appear on a single 
line and are typed following the SPAT message ST=?. Where X and Y appear below 
the student would type explicit decimal numbers or expressions composed of 
symbols and decimal numbers; m and n are used in place of X and Y where symbols 
can only operate on Integers or on expressions which take on integer values. 



SYMBOL 


ST=? 


HWERPRETATION 


+ 


X+Y 


add Y and X 




X-Y 


subtract Y from X 




-Y 


negative of (l.e. opposite of) Y 


/ 


x/y 


X divided by Y 




X*Y 


X times Y 


** 


X**Y 


X raised to power Y 


(,) 


( — )^X 


the expression within parentheses times X 


u 


1 1 

1 

1 

1 

1 1 


the expression within brackets times X 


R 


RX 


square root of X 


F 


Fn 


nl l.e. n factorial; n must be no greater than I70 
(e.g., F 4 = 2 i|=J+* 3 ‘ 2 *l) 


C 


mCn 


the number of combinations that can be obtained from 
m things taken n at a time; mCn=J^/[Fn*F(m-n)] 


L 


Im 


the value previously computed by STAT in line m; Im 
may be used In the same manner as X, Y, m, n, are in 
. STa? ■ 
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Your most frequent use of OFTION 12 will be for calculations on sample data 
obtained in OPTION 1. Such calculations are more conveniently done with the 
following symbols which, may be typed by the student, in the expressions 
submitted in ST=?, as if they were explicit numbers. 

These symbols may replace explicit niimbers in OPTION 12: 

DEFINTTION 



sum of data in column 1 

sum of data in column 2 

sum of squares of data in column 1 

sura of squares of data in column 2 

sum of products of data in the same row of columns 1 and 2 
sum of differences of data in the same row of columns 1 and 2 
sum of squared differences 



An additional = sign may be typed by the student (in addition to that printed 
by the computer) to indicate where evaluation is to begin. This allows 
comments or labels to be inserted for reference only, e.g., 

LINE 1. 

ST=? MEAN=8l/lgl An additional equal sign follows 

the label MEAN. 

LI* 43.0000 

Try END as your last reply to gp=? to exit from OPTION 12 . 

If you reenter OPTION 12 during the same problem, line numbers continue from 
where you left off. 



SYMBOL 

51 

52 

551 

552 
SCP 
SMD 
SSD 
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EXCERPT FROM arUDEWT^S WORK WITH STAT 

(Note: References which are printed by STAT as In the case of 

OPTION 11 below, are for the textbook by Hays, Statistics for 
Psychologists . The underlined messages were typed by the student.) 

PROBLEM 1.07 

IN A FIELD TEST OF A NEW SER'JM A LARGE SAMPLE 
WAS DIVIDED INTO TWO TREATMENTS. TREATMENT 1 RECE- 
IVED THE SERUM# TREATMENT 2 DID NOT .. THE DATA 
RECORDS THE NUMBER OF CASES IN EACH CATEGORY FOR THE 

ENTIRE sample. , , ^ . 

TEST THE PROPOSITION THAT ThE SERUM WAS EFFECTIVE. 

USE THE 0.05 LEVEL OF S I GN I F ICAN IE . 

OPTION*? 1 



THE SAMPLE VALUES FOLLOW: 

TREATME NT --HEALTHY-- INFECTED 
1 - 219 3 

2- lb6 1 

» 

OPTION*? n 

' SOLVE FOR EACH QUANTITY SPECIFIED BY THE STEPS . 
STEP 1 

FISHER exact TEST: P59&# SL7.9 



OPT I0N=? 

CALCULATION ASSISTANCE. 

L I N£ 1 . 

ST*-? 409C222 

Ll = TTT68M991E + 121 

ST=? [(405C21 9)*(aC 3 ) 3/Li 
L2 = 0 .292fe 

ST=? f(A05C21 b)*(ACA) ]/Ll 
L3 = 0 .0857 

ST = ? L2^^L3 

L4 a 0.3785 

STa-^ END 

(Continued on Page 71* ) 
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(Continued from Page 70. ) 



OPTION*? 8 

— # 

Ev/AL'JAT ION 

ANSWER IJIJESTIONS AS DIRECTED OR TYPE *8ACK' OR ’STJCK.' 
ENTER THE SIGNIFICANCE LEVEL OBTAINED FRON? YOUR TEST. 
(IF YOU USED A TABLE# GIVE NEAREST APPROXIMATION.) 

Ps? .3785 

PROBABILITY INCORRECT. 

CORRECT BEFORE PROCEEDING. 

FISHER EXACT TEST: P598/ S17.V 



I 

« 

I 



i 



i 



OPTION*? A5 

j 

FISHER EXACT PROBABILITY | 

i I 

ENTER THE NUMBER OF 'SPECIALS' OCCUR ING IN THE EXPERIMENTAL GROUP. 

NUM*’ 3 

ENTER THE TOTAL NUMBER Oi- 'SPECIALS.' 

NUM=? A I 

ENTER THE EXPERIMENTAL GROUP TOTAL. 5 

NUM*’ 222 

PROBABILITY = B.VM)3 

OPTION*? 

-ANSWER- ♦♦♦♦ ^ 0 . 91^3 

OPTION*? _8 i 

'■5 

EVALUATION j 

ANSWER QUESTIONS AS DIRECTED OR TYPE 'BACK' OR 'STUCK.' j 

ENTER THE SIGNIFICANCE LEVEL OBTAINED FROM YOUR TEST. .. 

(IF YOU USED A TABLE# GIVE NEAREST APPR OX 1 MA T I ON . ) 

P*? .91 A3 ^ 

NOW YOU ARE CORRECT. 



Noi^: Because the student used IJBRARY OPTION U 5 he is forced to work the 

problem again, with new data ] this time the UBRARY OPTIONS are not 
available to him. 




(Continued on Page 72. ) 
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(Contined from Page 71 , ) 

PROBLEM 2.07 

IN A FIELD TEST OF A NEW SERUM A LARGE SAMPLE 
WAS DIVIDED INTO TWO TREATMENTS. TREATMENT 1 RECE- 
IVED THE SERUM, TREATMENT 2 DID NOT. THE DATA 
RECORDS THE NUMBER OF CASES IN EACH CATEGORY FOR THE 
ENTIRE SAMPLE. 

TEST THE PROPOSITION THAT THE SERUM WAS EFFECTIVE. 
USE THE 0.05 LEVEL OF S I GN I F ICANCE . 

OPT ION*’ 

the sample VALUES FOLLOW: 

TREATMENT --HEALTHY-- INFECTED 
1 - 1 4 

2- 199 6 

OPTIONS? 12 

I CALCULATION ASS ISTANCE . 

L I NE 1 . 

STs? C(394C1 95) *(100 4) I/404C1 99 
Ll » 0 .2127 

STr ? C(3 94C1 96 ? ♦( 1 0C3 ) 3/40 4C1 99 

L2 ■ 0 • 1234 

ST.-J ( (3 94C1 97 )»(10C2 ) 3/404C1 99 
L3 a 0 .0465 

ST»? r(394Cl 98)»(10Cl )]/404C 199 
L4 a 0.0103 

STs? C(394C199)^(10C0) 3/404C199 

L5 s » “ 0 .0010 

# 

STs? Ll ♦ L2-*-L3’»-L4»<-L5 
L6 • 0 .3940 

STs? E^ 

OPTIONS? 8 

VALUAT ION 

NSWER QUESTIONS AS DIRECTED OR TYPE 'RACK* OR 'STUCK.* 
NTER THE SIGNIFICANCE LEVEL OBTAINED FROM YOUR TEST. 
(IF YOU iJSED A TABLE, GIVE NEAREST APPROXIMATION.) 

Pa? .394 

GOOD WORK. NO ERRORS. 
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A BRIEF USER*S GUIDE TO PLANIT 
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The hash mark is used to enter the COMMAND mode (PIANIT prints UNRECOGNIZABIE 
ClIARACTER if the student attempts to use it). 

The CO command is used to enter the Lesson Building mode to Commence or COntinue 
building lessons. 

The EX command is used to enter the Execution mode. 

The up arrow is used to return to the mode from which the CALC mode was entered. 

The left arrow is used by the student, or the LD playing student, to enter the CALC 
mode. 

The CAK; command is used by the LD to enter the CALC mode. 
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Figure 1, Mode Selection Commands 
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(q) The Question Frame 



The question frame is extremely flexible and would probably be used mostly for 
general interaction with the student. 



This frame ceui be used in two basic ways; (l) Constructed response; and 
(2) Dichotomous answer (POS/NBG). 



A new user should look at the constructed response type first. This version 
of the Q- frame may be the only one a LD needs for his lessons. 



Constructed Response 



(Remember, all information not prefaced by an asterisk is typed out by PLANIT, 
All infonnation prefaced by the asterisk is typed in by the LD. ) 



Simple use of the Q- frame. The LD types in Q, PLANIT responds with: 
FRAME 1.00 LABED=*HIST 



2. TEXT, 

*? 

2. SPECIFY QUESTION. 

*WHO INVENTED THE ELECTRIC LIGHT? 



3* ANSWERS. 
*A+THOMAS EDISON 

*B ALEXANDER BELL 

* 



h, ACTIONS. 

*A FrTHATS VERY GOOD B:3 

*B R;HE INVENTED THE TELEPHONE, TRY AGAIN. . . 
*-R: 



Explanation of Frame 1 



All frames are automatically numbered. Here the LD chooses to label the frame 
HIST, (if he chose not to label the frame, he would merely strike the space 
bar followed by the carriage return and pass oh to Group 2. ) 



2« TEST# The LD was not sui^ what TEXT stood for and typed in the question mark 
(?). PLANIT immediately elaborates with 2. SPECIFY QUESTION. The LD then types 
in his question "Who invented the electric light?" PLANIT returns with an as- 
terisk waiting for more lines of input. PLANIT has no way of knowing when the 
I LD is through with the question group and so’ returns with an asterisk for each 
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next line. The LD ends the group by striking the space bar once and then the 
carriage return key. There is no theoretical limit to the number of lines that 
can be entered in-^ach group. We do, however, have a practical limit of 60 
lines for the entire frame. 

3 . ANSWERS. After the LD enters the space and carriage return, PLANIT returns 
with 3 . ANSWERS. A stroke of the ? would have produced the elaboration 3. 
SPECIFY ANSWER. The LD now enters all the anticipated answers he will accept. 
In doing so, he tags the first one A and the second one B. Note the + next to 
the tag A, this indicates to PLANIT that this is the correct answer. Having 
finished entering answers, the LD indicates this by a space and carriage return 
(CR) and we go on to the action group. 

U. ACTIONS. Stands for SPECIFY ACTIONS; the LD could have discovered this 
with a stroke of the ? key. In this group we specify that we want to do next 
depending upon which answer the student gives. Action specifications for any 
given tagged answer must be confined to one line. 

There are four types of commands in the action group: F:, R:, C:, B:. 

F: means that what follows is the feedback message to be presented to the 
student. If no message follows F: , then PLANIT will choose one from its 
feedback table. PLANIT has a list of correct and incorrect feedback message 
and will select one from the appropriate list (randomly) according to whether 
the answer associated with this action was correct or incorrect. This 
'allows the LD to enter F: by itself, knowing the student will not always 
get "YES" or "NO" feedback every time he enters an answer. The response will 
normally be one-word messages, e.g., YES, FINE, CORRECT, SO, or NOT TRUE, 

NO, WRONG, etc. 



R: operates the same as F:, except that R: also instructs PLANIT to wait for 
another answer (i.e., do not print out the question, Just wait for another 
answer). Finally, R; by itself means print out the fixed message, "WRONG, TRY 
AGAIN" (then wait for another answer). 

C: by Itself means print out the fixed message "THE CORRECT ANSWER IS" followed 
by the correct answer as indicated by the plus (+) in Group 3» C: can only be 
followed by another command, e.g., F: , R: , C: , B: or a CALC statement. For 
example C: CONTCONT+1. This puts PIANIT in the CALC mode at that point. CONT 
is an item in CALC; here the LD would be incrementing CONT by one (see CALC 

2 . 3.1 and 2.4). 

« 

B; means breuich (e.g., B:3 means branch to Frame 3)» All frames are numbered. 
They can also be labeled, and a branch can be made to any numbered or labeled 
frame. In addition, "B;ISNAM" where ISNAM is the name of another lesson, means 
that the lesson ISNAM will now be brought into PIAiLET and executed ( Just like 
another frame; the student will never know the difference). Upon completion of 
the lesson LSNAM, PIANIT will continue with the next frame in the original 
lesson. 
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B: by itself with no label or niuiber following it means return to the calling 

lesson (i.e., if lesson AA called on lesson BC "B:BC", then PLANIT would return 
from lesson BC when PLANIT comes across "B:"). If CNT is some item and 
contains a number (put there in CALC perhaps), then B:CNT means branch to 
the frame number contained in CNT; e.g., if LINK contained the value 20, 
then BtLINK means branch to Frame 20 and execute as per the instructions in 
Frame 20. Frames mentioned in a branch need not exist unless that branch ■ 
is executed during the running of the lesson. If it is executed euid no 
frame exists, then PLANIT will interrupt the lesson and print out an error 
message stating the illegal branch, the frame, group, and line number where 
it was requested. 



The first line in Group 4 is read as; If the student gave Answer A (i.e., 
THOMAS EDISON), then print out the message; THATS VERY GOOD and then branch 
on to Frame 3 • 



The second line is interpreted as; If the student gave Answer B, then print 
out; HE INVENTED THE TELEPHONE, TRY AGAIN... then wait for another answer. 



The third line indicates an action to be performed if the student's answer did 
not correspond with 'either A or B; i.e., for any unanticipated answer (actions 
prefaced by the minus sign), repeat the frame. (In this case note that nothing 
appears after the R;. This means print out the fixed message; WRONG, TRY AGAIN 
and wait for another answer.) 



The LD terminated the frame by striking the space bar and the carriage return 
tey (CR). 



Remember, the space bar and CR alone on any line terminates the group. The 
dollar sign ”$" and CR alone on any line terminates the frame. If, for example, 
the LD (in the middle of Group 3) decided to end the frame and go onto the next 
frame, he would only have to enter the $ and CR alone on a' line and PIANIT would 
respond with; 
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p/q/m/d/c . 

FRAME 2.0^ IABEL=*MATH 
2 . TEXT. 

*LETS SEE WHAT YOU REMEMBER ABOUT TEMPERATURE. USING F FOR DEGREES 

^FAHRENHEIT AND C FOR DEGREES CENTIGRADE, WRITE THE FORMUIA FOR 
•»»CONVERTING FROM DEGREES FAHHEITOIT TO DEGREES CENTIGRADE .\ 

* HINT: F=9*C/5+32 CONVERTS FROM CENTIGRADE TO FAHRENHEIT. 

* 



3 . ANSWERS. 

*0 FORMUIAS ON 
*A+C=(5/9)*(F-32) 
*B F=9*C/5+32 
*C C=(5/9)^F-32 
* 



I 






f 



k. ACTIONS. 

*A F: B:7 

*B R:YOUR ANSWER IS THE SAME AS THE ONE I GAVE YOU, TRY AGAIN. . . 

*A F: NOW YOU'VE GOT IT. B:15 

*B R: YOU 'RE STILL CONVERTING FROM CENTIGRADE TO FAHRENHEIT, TRY AGAIN... 

*BC C: F:NOTE THE DIFFERENCE. B:OUT 

*-R: 

*-C: 

* 



Explanation of Frame 2 : 

The LD labels this frame MATH. 

2. TEXT. The LD enters his question. Notice the back slash "\" after 
CENTIGRADE on the 3 rd line . This instructs PLANIT to skip a line after 
printing out centigrade. To a student taking the lesson, the question would 



I come out as: 

I 

I lETS SEE • DEGREES 

I FAHRENHEIT FOR 

I CONVERTING CENTIGRADES 

I 

j HINT: F=9*C/5+32 FAHRENHEIT 




* (Where the asterdsk tells the student that it's ready for his answer.) 
The '\" caA be used anywhere in Group 2. Two in a row ’\\" means skip two 
lines, etc. 
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3 . ANSWERS. This group illustrates the algebraic matching ability of PIANIT 
(turned on by the expressions 0 FORMULAS 0N)« The student can type in any 
equivalent algebraic form of the correct answer and get full credit for it; 
e.g., C=(F-32)*(5/9), C=5*(F-32)/9, C=(5*F-16 o)/ 9, etc., are all equivalent • 
and therefore acceptable forms. If FORMULAS is not turned on, or is turned 
off by the expression: 0 FORMULAS OFF, then only the exact form as typed in 

by the LD would be looked for in the matching. 

We do not wish to mislead the user; this is not true symbol manipulation. We 
tnerely employ a technique which (in part) includes performing algebra on the 
student’s answer. For details on the technique see Note 1. 



Note: (5/9)*(F-32)=C is not considered an equivalent form to PLANIT. Naturally 

the matching technique is not restricted to correct answer alone but worlds for 
all anticipated answers in Group 3* 



4 ♦ ACTIONS. This group illustrates repeated use of a' frame. 

The first time through this frame, if the student's answer corresponded to: 



A— ha would receive a (randomly selected) feedback message followed by a 
branch to Frame 7 • 



B-i-he would receive the feedback message "YOUR ANSWER IS THE SAME AS THE ONE I 
P GAVE YOU, TRY AGAIN. 

i, I (Remember the R: means wait for another answer.) 

C— he would receive: NOTE THE. DIFFERENCE. THE CORRECT ANSWER IS: 

C=(5/9)*(F-32) followed by a branch to the frame whose label is OUT. 

If his answer did not correspond to either A, B, or C (unanticipated response) 
he would have received: WRONG, TRY AGAIN. 



The SECOND tims through the frame, if the student's answer corresponded to: 

A— he receives: NOW YOU'VE GOT IT. following by a branch to Frame 15* This 

action is performed regardless whether or not his first answer corresponded to 
A. In other words, the nth repetition of a lettered (or numbered) action, 
counting from the top of Group 4, is performed the nth time through the frame 
(provided, of course, that his answer corresponds to that lettered or numbered 
action). Again the action chosen is dependent only upon the student's answer 
and the number of times he has been through the frame and not upon what answer 
he gave before in this frame . 

B— he receives; YOU'RE STIIiL CONVERTING FROM CENTIGRADE TO FAHRENHEIT. 

TRY AGAIN. . . . 



C he receives the seate as he would have gotten the first time through the 

frame had his answer corresponded to C then. 
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# 



If no match (2nd unanticipated answer) he receives: 

THE CORRECT ANSWER IS: C=(5/9)*(F-32). PLANIT would then go on to the next 

frame in the sequence. 

The THIRD (or more) time through the frame, if the student’s answer corresponded 
to: 

A, same for A the second time through. 

B, same for C any time through the frame. 

C, same as before. * 

Unanticipated answer, same as second time through. 

Note: F: C: R: B: appearing on one line are done in the order shown. If the 

same command appears more than once on the same line, the priority is from left 
to right. If "B:" appears more than once on any line, the left-most branch will 
always be executed. 

If there is no Group then all commands in Group 4 will be executed, and 
there will be no pause for the student’s answer. 
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Specifications for FORMULAS, KEYWORD, and PHONETIC^ 



A. 



What they do; 

FORMULAS OFF implies that the student's answer is to be regarded as a 
standard English reply (i.e., word, number, phrase or sentence). 



FORMULAS ON implies that the student's answer is to be regarded as an 
algebraic formula where commutative, associative, and distributive rules 
hold. Names are interpreted as parameters of the formula to which 
arbitrary numbers could be assigend. 






i 



1 



*For details on techniques used in FORMULAS and PHONETIC, see Note 1 and 
Note 2 respectively. 
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KEYWORD ON provides a means for disregarding everything in the student's 
answer except that which occurs in the LD answer to be matched. The minimal 
acceptable reply is that vrhich matches the LD's answer. This reply may be 
a part of a longer reply. 

KEYWORD OFF implies an exact match word-for-word. 

PHONETIC ON implies that all words in both the LD's answer and the student's 
reply will be reduced to a phonetic encoding and the encoded messages will 
be compared - not the original messages. 

PHONETIC OFF disallows that function. 



B. How to use them: 




Each of the three is controlled in exactly the same way. They can be turned 
on or off in CALC or in any statement on which CALC operates. Once turned on, 
they will be automatically turned off again when advancing from one frame to 
the next unless the SET operator is included. If they are SET on, they will 
remain on until that status is changed by a subsequent declaration of the 
status of that function. 

The chart below shows several uses: 



In CALC ■ In Answer Group In Action Groups 



Temporarily 


KEYWORD ON 0 KEYWORD ON C: KEYWORD ON 


ON 


or 1 KEYWORD ON 


Set 


SET KEYWORD ON 0 SET KEYWORD ON C: SET KEYWORD ON 


ON 


or 1 SET KEYWORD ON 


OFF ■ 


KEYWORD OFF 0 KEYWORD OFF C: KEYWORD OFF 




or 1 KEYWORD OFF . 



Note: In the answer group, the 0 implies that the action will be taken before 

the student responds, while 1 or greater implies that the action will be taken 
at the position found in the process of answer-matching. 



C. How they work: 




Their function will be noticed only in question-type frames for answers with 
letter tags. The following chart shows the various combinations. 
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FORMUIAS ON 



FORMUIAS OFF 



KEYWORD# 

ON 


Answers will be treated as 
algebraic formulas. Order 
is unimportant to match, at 
least the keywords must be 
found. 


Words appearing in the answer 
must appear somewhere, properly 
ordered, in the student's reply. 




Answers will be treated as 


Everything in the answer must 




algebraic formulas . Order 


appear in the same way in the 


KEYWORD 


is unimportant. Every word 


student's reply. Only leading 


OFF 


in the answer must occur in 
the reply and no others. 


and trailing blanks are ignored* 



In each case, PHONETIC ON sinrply phonetically encodes the words. 



D. Operational definitions: 

A word is a string of letters with a bleink before and after it, i.e., EDISON. 

With FORMUlAS OFF, any string of characters set apart by blanks are handled 
as unit ’’words." 

With FORMULAS ON, the word is a string of letters that may or may not have 
digits attached on the right, i.e., MEAN SUMl RH 012 



Et Restrictions and special conditions: 

1 . With PHONETIC ON, only the first sixteen letters of each word will be 
encoded. ^ 

’ 2 . With FORMUIAS ON and PHONETIC OFF, all words must be distinguishable 
within the first eight characters; i.e#, FREQUENCY would match with 
FREQUENCIES* No such restriction holds with FORMUIAS OFF. 

3. With FORMUIAS ON, punctuation is ignored and arithmetic symbols retain 
their function. 

4 . With FORMUIAS OFF, no symbol has special meaning and must be matched 
exactly# Punctuation is not ignored unless KEYWORD is on. 

5. FORMUIAS ON is often useful for other than formula replies, e.g., 

THOMAS EDISON would allow EDISON, THOMAS to match correctly (the comma 
is ignored and order is not obser^'ed). 

♦Periods, comnas, question marks, and extra blanks are ignored with KEYWORD on. 
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6, All answers are restricted to a single line. 



F. Other frames: 

1. Multiple choice frames always require a single letter in reply. No 
other reply is accepted. That letter must match one of the tags in 
the answer set or else another answer is requested by the message: 
"CHOOSE ONE OF THE ABOVE lETTERS." 

2. Answers tagged with numbers in a question frame imply FORMUIAS ON, 
all else OFF, and no letter will be acceptable in the reply in order 
for a match to occur. Thus, 1 will match 1.0 or 3/3 or 3*1 T^^t not 
x/x. If all answer tags in any question frame are numbers, th’en 
PIANIT will not accept a reply to that question if it contains letters. 
Another answer will be repeated with the message , "NUMERICAL ANSWER 
PIEASE." 

f 

# 

■(d) The Decision Frame 

This is an extremely powerful frame and can be used for determining just about 
anything the student has done. In this frame the LD specifies branching (or 
any of the three F: C; B; ) conditions on a basis of a pattern of errors over 
several frames. He can also query the contents of items set in CALC. Finally, 
he can combine his decisions to be a function of what the student has done over 
a set of frames plus the contents of items set in CALC. 

Decision frame questions are composed of the following primitives: 

1. The Connectives: ' IF, AND, OR. 

2. The Relational Operators; LS - less than; IQ - less than or equal to; EQ - 
equal to; GQ - greater than or equal to; GR - greater than; and NQ - not 
equal to . 

3. The Conditions: RIGHT, WRONG, SEEN, USED, MINUTES, 

if. Frame numbers and labels. 

5. Lettered or Numbered answers. 

6. CALC expressions. 

The beginning of any decision question must start off \ilth the "IF" connective. 
The question can run over onto more than one line^but all lines must start off 
with a connective. 
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' The questions can have any one of three forms: 



A. IF Frame number (or label), Lettered (or. numbered) answer -+. 

E.g., IF 5,AB 7-12, + 3, IP 

This is interpreted as follows: If the student went through Frame 5, Answer A 

or B and then went through Frames 7 to 12 (inclusive) correctly and then Frame 
3, Answer 1 or P and then saw Frame 6 . The first form is the "Pattern" form for 
it describesHan exact pattern. In order for this question to be satisfied, the 
student must go through the frames mentioned in the exact order specified with 
no deviations to frames in between nor 'to the answers given. 

B. IF Relational number RIGHT (WRONG, SEEN, USED, MINUTES) Frame numbers . 
( labels ) . 

E.g., IF GQ 5 WRONG l,7,IAB-25 

If the student got at least five wrong out of Frames 1, 7^ and all frames betwee 
the frame labeled "LAB" and Frame 25* 

E.g., IF RIGHT 3-5* If he got Frames 3 to 5 right. 

E.g., IF LG 5 WRONG. If he got five frames wrong. 

In this form any part is optional and can be left out except RIGHT, WRONG, or 
SEEN. 



E.g., IF ■ USED FACT 1, 2 and USED !vIEAN 3- 

If he used the primitive CALC function "FACT" in either of Frames 1 or 2 and 
used the LD defined function "MEAN" in Frame 3 . 



C. IF CALC Expression Relational CALC Expression 

E.g., IF CNT GQ 5 . If the contents of CNT is greater than or equal to five. 



E.g., IF FACT(CNT)-SQRT(STUDIQ(5,CNT))*TAN( 50)^2 LS C0MB(5.CNT). 

If the factorial of the contents of CNT minus the square root of the element of 
the matrix STUDIQ whose subscripts are 5 and the contents of CNT, tmes the 
tangent squared of ^0 is less than the combination of 5 things taken CNT at a 
time. 

All of the three forms. A, B, and C can be connected by any of the connectives 
AND, or OR. 

E.g., IF 3,AB LAB,+ OR 2 SEEN LOGIC AND IQ LQ 120 
OR GQ 3 RIGHT HIST-MTH. 



If the student went through Frame 3 , Answer A (or B) and then was correct on 
LAB OR he has seen the frame labeled LOGIC twice and the contents of the item, 
IQ, is less than or equal to 120 OR he got at least three right out of. all the 
frame between HIST and MTH (inclusive). 




E.g., IF IQ 20 MINUTES 1-5, 7 if the student went through Frames 1-5 and 7 
I in at most 20 minutes. This in'cludes all repetitions of frames. 




t 
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The terms of these expressions are separated by OR’s. Although no parentheses 
are permitted, they vill be used here to clarify the order in which the example 
Just given would be evaluated. 

IF (3,AB IAB,+ ), OR (2 SEEN LOGIC AND IQ IQ 120) 

OR (GQ 3 RIGHT HIST-MTH). 

The terms are always evaluated left to right. 



p/q/m/d/c 

*D 

FRAME 9.00 IAHEL=^DET 
2. CRITERIA. 

* IF’. 3,- F: LET'S TRY SCM EXAMPLES B:EXAM 

* IF 5-10,SK EXAM,+ OR IQ 2 SEEN 20,23-25 B:T2 

* IF 2 RIGHT HIST-MTH AND STUDIQ IQ I30 OR 7-10,ABCD56 

* AND ALL SEEN 5-35 C:CNT=10 C:LINK(2)=25 B:105 

* IF NONE SEEN 5-50 OR 5^ 6,+ 

* F;FINE NOW YOU'VE GOT IT C: TEMX=FACT(40) B:67 




Explanation of Frame 9*. ^ 

.The first line reads: If he got Frame 3 wrong, printout the feedback message 

"LETS TRY S(M EXAMPLES"' then branch to frame whose label is EXAM. 

The second line reads: If he went throu^ Frames 5 to 10, answers S or K, and 

then went throu^ the fiame whose label is EXAM correctly OR he has seen at most 
two out of Frames 20 and 23 to '25, then branch to Frame 72. 



The third line will be easier to follow if we label its terms. 

Let: 2 RIGHT HIST-MTH A; STUDIQ IQ 130 “* B; 7-10,ABCD56 C; 

ALL SEEN 5-35 "" D 

Then line three is read as: IF (A AND B) OR (C AND D). 

Then set CNT e^ual to 10, XiINK(2) equal 25 and branch to Frame 105. 

Finally, those last two lines introduce the use of ALL and NONE. In the first 
one we have: If the student has seen ALL the Frames 5-35* In the second we 

have: If he hasn't seen any of the Frames 5-50.- 




As shown in Group h of the Q-frame,'the action commands can be grouped with a 
particular answer. Similarly in the Decision frame, .action commands F, C and B 
(R not used) can be grouped following an IF statement. Remember, to continue a 
feedback message onto more than one line , the lines must start with "F: ' . 
Commands not prefaced occurring at the top of the frame are done first. 
























i 
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E*g*> 

FRAME X IABEL=X 
2. CRITERIA. 

*F:THIS IS DONE FIRST, THE REST OF THE GROUP 
*F:IS THEN PROCESSED. 

♦IF l,A...etc. 



Search Boundaries: 



If 



All examples shown thus far imply restrictions to the scope of the search, 
this is the first time this frame is used (i.e., this frame number appears 
nowhere else in the student's record), the search begins from the first frame as 
before. If, however, this decision frame was used before, then the search 
starts off from the frame record associated with the last time this decision 
frame was used. 



The LD can override the limitation by specifying the frame number from which the 
search will begin. He can use the primitive "FROM" followed by the frame number 
or label. The primitive "FROM" is used just after the "IF", e.g,, IF FROM 20 
OQ 5 RIGHT... etc., or IF FROM EXAM GQ 5 RIGHT... or IF FROM 5 6,A 7,BCD...the 
search 8tax*ts off from the last occurrence of that frame record whose number is 
the same as that which follows the primitive "FROM" in the decision statement. 



If the frame number is not found, a search is made of the entire record to see 
if the pattern is satisfied aayvhere. 



Remember, the pattern must exist exactly as specified in the decision question 
(with no deviations). The search starts from the beginning of the lesson and 
ends when the question is satisfied or until the last record is examined, which* 
ever comes first. 



Finally, for RIGHT and WRONG, D (decision) and P (problem) type frames are 
ignored. 



|er|c 

KUBBSS ’ 






latiH 









mfmmmm 






!S5!gj555^a5I^53i5^S55SS5^fti*Hfw i 



I 





30 October I967 



91 



TM‘-29lU/l00/00 



Consider the following examples: 





FRAME 


ANSWER. 


RIGHT A^ONG 


FRAME TYPE 


1* 


1 


A 


+ 


Q 


2* 


2 


K 


- 


Q 


3. 


5 


A 


- 


M 


4* 


7 


C 


+ 


Q 


5. 


11 


C 


+ 


Q 


6* 


4 


P 


- 


M 


7. 


5 


•B 


+ 


M 


8* 


7 


C 


+ 


Q 


9. 


7 


C 


+ 


Q 


10* 


9 


C 


+ 


Q 

# 


11* 


10 


C 


+ 


Q 


12* 


20 


0 


- 


D 


13. 


15 


s 


+ 


M 


14* 


35 


0 


- 


P 


15. 


12 


0 


+ 


D 


16* 


20 


0 


— 


D 



Figure 2 



A) IF FROM 1 3, AB T-10, C 

B) IF 4 SEEN 5, 12-35 

C) IF 3 RIGHT 5, 12-35 

Referring to Figure 2, Question A would be satisfied* Note that the pattern is 
disturbed in Lines 3-5, but the search continues and a complete match is found in 
Lines T-U*. By removing the "FROM", Question A would not be satisfied^ since the 
specified pattern occurred prior to the last use of Frame 20. 

Question B would not be satisfied* Although the student did see four frames, he 
did not see all four in between the limits as determined by the use of Frame 20 
previously* 



Question C would not be satisfied for similar reasons given to B; i*e*, he was 
correct on them all, but not within the two appearances of Frame 20* Notice that 
by adding "FROM 2" to Questions B and C, both would then be satisfied, i*e*, 

B) if FBm 2 4 SEEN 3, 12-35 

C) IF FROM 2 3 RIGHT, 12-35 




’i 

I 

\ 



*A11 frames in between 7 and 10 need not occur for a match* The only require- 
ment is that the frame numbers are sequential (i*e., the next number is greater 
than or equal to the preceding one) and that the two frames mentioned (7 and 10) 
appear* This is with respect to pattern-type questions and does not apply to 
forms using RIGEPT, WRONG, ETC* 
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6. Drop names 



♦DROP X 



GORE 



7» ' Ask for values not given 
*Y + Z1 -f Z2 



ENTER VALUES (COMMA.S BETWEEN) FOR: Zl, Z2 

#3# ^ 



12 = 12.707 

"N fr 

8. Change the precision 



*2 PIACES. 
IN 



*12 



L3 * 12.71 



9» Print all options which can be concurrently used 



♦PRINT OPTIONS 

RESTORE DEGREES RADIANS CH/^E SET TO PRINT DROP PIACES 
NAMES ASSIGN FOR MATRIX ARRAY READY OPTIONS VERBOSE CONCISE 
SUM PROD RESET FUNCTION RANDOM FINISHED ALLOW KEYWORD 
PHONETIC GOTO FORMULAS WITHIN PROHIBIT TIME FRAME WAIT 

RESPONSE F C R B P D I CALC CONTINUE EXECUTE GET 

SAVE DISPUY RESTART NOLINK NONE ADD ALL BUT ONLY USED 
NOT RIGHT WRONG SEEN MINUTES 



10. Print all names which can currently be used 



♦PRINT NAMES 

N VALUES STEPS HELP RANK SG^RT COMB FACT LOG LN SIN COS 
TAN COT SEC CSC ABSOLUTE TRUNCATE ZTOP PTOZ PTOT PTOX 
DATA 












1 
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11. Define a matrix (maximum four dimensions) 

^MATRIX (ABC, 10, 10, 10) 

IN 

*ABC (1,1,1) * L2 . , 

ABC » 12.71 
Z * ABC (1,1,1) + Y 

3 - 18. U2 . ' 

12. Set values or matrices into a protected area 
*SET Z 

DONE 

*SFT ABC 
DONE 

13. Drop all tenqoorary names 
♦DROP NAMES 

GONE 

Now Y, LI, L8, L3 have all been erased. Only Z euid matrix ABC 
remain together with the primltl-^^ names. 

14. Store and use functions. (Any number of arguments are legal but 
the function must be sing3.e -valued. ) 

♦FUNCTION. XYZ (X) - 2X + 4 

IN 

# 

♦Y * XYZ (3) + Z + *58 
Y » 29.0 

15. Do summation, products and transformations 

(The word DATA will be predefined by the program and the current 
values from the most recent problem will be preset. ) 



I 
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II 5 



There are certain other 

o?1graia:i^n'«fven during the lesson building 

mode. 



4 >a-t-^rknAi mode and resune interaction (lesson 
To leave this I student) the user eUher types 

:X~th:ds'aS'«^u^rthe person to the activity which he^ 
previously interrupted. 



capabiUty pluVthat which follows: 



19- 



He may change the name of any of his cormsmd list. 




^»#CALC 

OK* CHANGE CALC TO CCOTUTE 



DONE 



COMPUTE 



OK* 



20 . 



When he permanently ^^a^,^h"^iB^nit”aocLsible to 

rSntn^l>rJfan^rtS:lf^ in providing anticipated 
numerical answers to questions. 



*FUNC?TI0N MEANDIPF * SUM (DATA (l,l) ' (1>2)) / N(1) FOR 

(l-l,N(l)) 



IN 



*MEANDIPF 

-2.0 

The student mode cannot access that name 



fturtTtte^" 

access is denied. 






eric 



: -.vraw 












^ 30 October 1967 



98 



TM-2 914 / 100/00 



I 



Pi 



I 



NOTE 1 
« 

TECHNI(^lIE USED FOR EVALUA.TING AKjEBRAIC EXPRESSIONS 



With PX)RMUIAS ON, PIANIT will attempt to match equivalent algebraic expressions. 

The technique is as follows! 

1 PIANIT first searches the student's answer to see if all symbols (with the 
^e^lon Of numbers) in the U)-s answer exist in the student's answer. If 
the student's answer has missing symbols, the answer is wrong. If the 
symbols are all present, PIANIT will go on to Step 2. 

2. To all symbols in the LD's answer, it will assign successive prime numbers 
starting with 3 , going left- to right. 

3 . PIANIT will next perform the indicated arithmetic . 

4. It will compare numerical answer with student's numerical answer (obtained 
by the same routine). 

5 . If the answers are the same numerically, student's answer is correct; 
otherwise he is wrong. 

The following comparison will illustrate this process: 

LD's ANSWER POSSIBLE STUDENT ANSWERS 



A+(B+C)*D+5 a* 


A+(B*D+C*D)+5 


right 


b. 


A+D*(C+B)+5 


right 


c . 


1+4+D*(B+C)+A 


right 


d. 


D*(B+C)+5+3 


wrong 


If we go through the steps listed above, the LD’s answ^ wo^d work out as 
follows; First assign prime numbers to A+(B+C)*D+5. 3^A, 5^B, T"*C, lIr*D. 






Then perform the arithmetic. 

3 +( 5 +T)* 11+5 = 3+(55+TT)+5 = 3+132+5 = 140 

Student Answers a, b, and c are fine because they have all the symbols and, 
when prime numbers are substituted for the same symbols as in the LD s answer, 
the numerical result is the same. Answer d is wrong because it has one symbol 
missing (even though the numerical result would come out the same). 



ERIG 
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A+(B-K;J )*D+A+2 would also be correct since in this case A gets the value of 
three assigned to it. Note that this is not the right answer but gets through 
as such because of the technique employed. Care must be used to avoid this 
problem, although the chances are small that this could happen by accident. 

To insure the uniqueness of the answer obtained by this routine, two or more 
passes could be mauie through the LD's answer set assigning each time new 
numbers to evaluate. , The student's einswer would then be evaluated each time 
(once for each set of numbers). However, it was felt that the extra coding 
and processing time involved was not worth it. 
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NOTE 2 



PHONETIC ENCODING* 

f 

The technique used for encoding a word phonetically consists of four steps or 
passes^ shown below. (The word upon which Steps 2, 3> k operate is the 
output from the previous step. ) 



A. Letter equivalent. The first pass maps all letters into their letter 

equivalents (i.e., every letter in Row 1 is transformed into the letter 
immediately below it in Row 2). All other characters go through unchanged, 
e.g. , ?-?, #~#> etc. 

1. ABCDEPGHIJKlk^OPQRSTlJVWXYZ (original letter) 

2. ABCDABCHACCU^BCRCnABHCAC (letter equivalent) 

i 

B. The H replacement. With the exception of the first letter in any word, the 
second pass tremsforms each H in the word to the letter which precedes it. 



C. Elimination of successive identical consonants. The third pass eliminates all 
but the first element of an uninterrupted sequence of a single consonant, e.g.: 

SITTING becomes SITING 
( ) SUCCESSIVE becomes SUCESIVE 

-"1, IRRESISTIBLE becomes IRESISTIBIE 

D. Elimination of all A*s. All vowels have been mapped into A (Step l), the 
fourth pass eliminates these, and the final word has no vowels. 

Examples: 



ORIGINAL WORD: 
Step A 
Step B 
Step C 

Step D (final) 



IRRESISTIBLE 

ARRACACDABIA 

ARRAGARDABIA 

ARACACDABIA 

RCDDBL 



PHONETIC 

BHAMADAC 

BBAMADAC 

BAMADAC 

BMDC 



FONETIC 

BAv'^C 

BAMADAC 

BAMADAC 

BMDC 



BILLBOARD 

BALLBAARD 

BALLBAARD 

BALBAARD 

BLBRD 



The user must by now be aware of the danger in using the phonetic routine: 
Undesirable words can sneak through as phonetical equivalents. For example: 
THINK and THOMAS are phonetically equivalent; i.e., THINK "* DMC and THOMAS 
DMC. Therefore, if the ID is looking for THMVS EDISON as the answer and the 
student types in I THINK IT WAS EDISON (KEYWORD ON in this case), he would 
get full credit. Nevertheless, the routine has shown itself to be extremely 
useful in many areas of practical concern and, "vdien used judiciously, can be 
most helpful. 




♦Patterned in concept from article: Hewes, W. L. , and Stow, K. H. , Information 

Retrieval by Proper Name, Data Processing Magazine , June 19^5 ^ 18-22. 
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The maximum number of letters that the routine can handle In a given word 
is l6. Additional characters remain unchanged. 



t 



I 







I 

t 



V. 

I 



)[ 

t 

f 



: 




I 







|||||||~^ 



HUliiBi 









aaii{aa^a^aaaiaaiiiaiaiiaiaya6i5iaa&s:^^ — 



I T-* '"' I i i I NI , 1 ^1 II II I 



I 




30 October 196? 



‘ 102 
NOTE 3 

Summary emd Basic Layout 



TM-291‘4/100/00 



1# commands ) 

The first of any group of legal commands must be prefaced with a # character. 
Succeeding legal commands may be written without , the #. 



T(gg|fti commands perfom four functions: switch operating modes^ man ipulate a 

[ lesson, editing the text of a ;ie8Son, and displaying student records. 

A. Switching mode of operation 

? #00 ) places PIANIT in the lesson-building mode at the next available 

#C0MTINUE) sequential frame number. (#00 is used to start building a 
lesson also. ) 

places PIANIT in the execution mode so that the existing lesson 
will operate as the student will see it. 

clears out data tables and starts over. PIANTT- responds with 

p/q/m/d/c. 

places PIANIT in the computational mode and makes available 
an iinrestrlcted use* of GALC. See the description of CAD: for 
added detail. Note : #CADC and ^ both cause one to enter the 

computation mode but ♦” is the more restricted student form. , 

I B. Manipulating an existing lesson 

#GET MATH ) moves a lesson from disc intp PIANIT or from PIANIT to disc. 
#SAVE math) The of a new lesson is assigned by the lesson designer 

(e.g. , math). The lesson name may have two to five characters, 
I must start with a letter, and may terminate with numbers if 

desired. Note : Duplicate copies of a lesson can be saved 

\ Bljoply by assigning a unique name to each. 



#EX ) 
#EXECUTE) 

#RESTART 



#CALC 







#GET MATH 1234 ) moves a lesson from magnetic tape into PIANII^ or from 
^ #SAVE MATH 1234) PIANIT to nmgnetic tape; otherwise, the same as above. 

The reel number is specified in place of 1234. 'Use 
0000 if a blank tape is desired. Contact the ccmiputer 
f operator for the reel number of the tape thus assigned. 

If 

S #GET MATH SMITH Transfers the lesson MATH as used by student SMITH into 

j PIANIT so that the records may be displayed. The LD 

I must give the correct identification for both himself 

I and the student. 



I 




'i 

t-- 

I 

I 



#SAVE saves a previously named lesson back onto disc. 

♦Note : If the lesson is on disc, PIANIT will ignore the tape number and retrieve 
the*"lM8on from disc. Use the system delete command and delete the lesson first or 
use another name. 
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The user will be ashed to identify himself. The same rules hold for the 
identification of a lesson name: two to five or less characters, all 

letters, or letters followed by numbers. 

C. Editing the text of a lesson 

Lines may be Inserted into a lesson, deleted from a lesson, or just 
. printed on the teletype by specifying the line or lines and following 
that with em I, D, or P, respectively (insert. Delete, Print). The 
critical part is specifying the line or lines. In the following examples 
a P will denote print but remember that an I or D could be used just as 
well for appropriate actions to occur. 

a. Specifying a single line: #1, 2, h, P (i.e., print line 4 in Group 

2 from Frame l). 

b. Specifying several lines: ^1, 2, 1-5# P (i»e»# print all lines between 

1 and 5 in Group 2 from Frame 1). 

c. Specifying entire groups: #1, 2, P (i.e., print Group 2 from Frame 1). 

d. Specifying several groups: #1, 2-4, P (i.e., print all groups between 

2 and 4 from Frame l). 

e. Specifying an entire frame: #1, P (i.e., print Frame l). 

f. Specifying several frames: #1-4, P (i.e., print all frames between 

1 and 4). 

g. The general form of \diich a. through f above were specific examples is: 

#FRM1 - FRM2, GRPl - GRP2, LINEl - UNE2, COMMAND 

\diere those frames, groups, and lines included in the specification 
are affected. Note the effect (above) of omitting certain optional 
parts of this general form. 

Note:- The absence of a command letter will be interpreted as a 
• print (P). ^ 

Frame labels may be substituted for frame numbers ;diere desired. 

For inserting frames, specific frames, groups or lines must be 
designated. One cannot specify the insertion of three lines in 
Group 4 all in one Edit command, for example; but the insertion of 
an entire frame or entire group can be specified. Avoid using the 
in insert ion-type editing. 











i 
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' D. Displaying student records 

I #DISP ) prints the records accumiilated on the student who was identified 

j^lSHAY) in the GET MATH SMITH command above, 

#DISP FRMl - FE?M2 ) same as above but for a subset of the records that 
j f^ISPLAY FRM 1 - FRM2) occur between the specified frames. 

2. The frame types P/Q/^0)/C 

[ The following paragraphs will explain what information to si 5 )ply in filling in 

grot 5 >s fbr the five types of frames, but remember, you are not required to 
j supply an entry for every group. If you wish to skip any group, type a space 

and return. If you have finished building a frame before the groups are 
[ exhausted, type ^0 or a dollar sign($). 

1 B- The Problem Frame, Nine groii^js (frame header always Group l). 

Groi;^) 2, Used for data base names (currently for experimental applicatipns) , 

Groi5> 3. Option control ALL/ALL BUT (TAN,1-3 )j etc. The calculation options 
I (functions) that are to be available to the student are specified 

here. 



( 



Group 4. Currently not in use. 



Gro\5) 5 . Steps to the solution. Each commeht separated by a semicolon 
constitutes a separate step. These will be printed by student 
request, one comment for each request. 



Group 6. 



Sample structure (0)ne, (t)wo independent groups, (M)atched groups, 
also student preference Y/N. e.g. , Y - allows the student to control 
sample size. 



Group 7. Population type to be used in generating the sample (information 
requested depends on the reply to Groiq) 6). e.g., NN specifies 

a bivariate Normal population. 



Group 8. Population parameters (information requested depends on reply to 
Grotps 6 and 7) and sample size if N in Group 6. 



Group 9i 



Sample header. The first line is for the data header remarks. The 
second line is for column location (place any character where the 
right edge of the column should line up). Remember that the first 
column will always be a tally column, numbering the rows of the 
sample. To delete this column, type a NO in place of its location. 
For example: 




BOYS — GIRLS 
No X X 



(Q) The Question Frame 

Two types - Constructed Response, POS/NEG 



me 
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Constructed Response 
Four groups 




Group 2. Any questions or text can be put here. j 

Group 3s- Enter all anticipated answers in one of two forms preceded [ 

by tags: j 



L ANSI ... where L represents an alphabetic character tag 
for the answer, "ANSI", or 

N ANS2 ... where N represents an integer tag* for the answer, 
"ANS2". 

Any number (up to 6o)^ lines can be specified for Group 3. 

The answer tags must be A-Z or 0-9. Identical tags may be 
assigned if the answers so, designated are not to be dis- 
tinguished from each other. A plus (+) sign immediately 
adjacent to any answer tag indicates that a student response 
which matches that answer will be counted correct. Several 
plus signs may thus be used. , 

Answer tags designate three functions: 

. Tags A-Z imply that the answer will be matched' exactly (or 
phonetically or mi nima lly if PHONETIC and KEYWORD functions 
are used. See below). 



I 






• Tags 1-9 imply that the designated answer is a ftinction of 
the arithmetic evaluation of the line. Simply stated, the 
line is put throu^ CALC first and matching is attempted on 
the result. Any legal CALC .statement may thus be implemented . 
KEYWORD ON, KEYWORD OFF, PHONETIC ON, PHONETIC OFF are four 
such legal GAIiC statements which appropriately set up methods 
of answer matching. Any CALC statement may be followed by 
the function WITHIN X where X represents a decimal number 
specifying an allowable error in the student's answer. For 
example : 

1+ MEAN(l) WITHIN .001 

The answer to be matched is the numerical result of the MEAN 
function and must be exact within the allowable specified 
error to be counted correct. 

Most GALC statements will not cause messages to appear on the 
teletype as they nonnally do in GALC. However, exceptions 
to this are the' GALC options PRINT and HELP, which will cause 
the corresponding messages to appear. 

• 

. Tag 0 should be interpreted in. the same way as Tags 1-9 
except for two important differences: (l) the associated 
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C 3 ALC stateirient will be done before the student responds to that 
frame rather than after; and (2) the result of the GAU; expression 
y-m not be matched to .the student's reply. 

All answer tags (except for Tag 0 ) are executed in order from top 
to bottom# regardless of any other sequence ordering, until a 
match, if any, is found. No further answers will be executed 
in that group after a match is found. Keep this in mind when 
using a dummy answer to turn off PHONETIC or KEYWORD. 

Group 4 . Action set. Four basic eoiKaands F: , B: , C; , Rs # 

* Each of the four commands, F: , Cj , R: , and Bt can be mixed as 
desired on a* given line of actions. Each ceui also have entries 
following the colon (e.g. , F: YOU AREN'T EVEN CI^SE. B: 5 )» 

In describing how these commands operate with and without entries 
following the colons, remember that the next command word is not 
considered to be in the expression that follows a previous colon. 
In the above exajnple, B is not included in the message, YOU AREN'T 
EVEN CLOSE. The colon following the B guarantees that B will not 
be considered in the previous message. 

F: For specifying feedbaclc. If no message follows F: PIANIT 

chooses one. 

I 

R: Provides for feedback messages same as F: but then waits 

for another answer. If no message follows R: PIANIT prints 
"WRONG TRY AGAIN. " 

B: Branch to frame number, frame label, lesson name, program 

name, or a CALC name of a frame number. NOLINK may be 
desired following the program name. 

B: with nothing following it, is legal only \rtien used as a 
return" to previous lesson. 

C: With nothing following it, causes PIANIT to print "THE CORRECT 

ANS'WER IS: (the correct answer)." The only thing that can 

follow C: is a CALC statement. This allows the LD to perfonn 
a CALC statement as a function of the student's answer. 

If these commands are preceded by the tag associated with the 
answer, they are performed only if the student's reply' matched 
an answer bearing that tag. Commands not preceded by a tag are 
done only if no match was found. 

Action commands for a tag must be complstely stated on one line^ 
e.g., F: message cannot run over onto another line. Any 
combination of actions can be used on any line and more than 
once, executed in the following order: F, C, R, B. 
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Tags occurring more theui once means the action 
associated with the first occurrence is done first 
time through frame. Second occurrence is done 
second time through frame, etc. 

POS/NEG form- of a Question frame. Has five groups. 

Group 2. Same as constructed response. 

Group 3. General form: AAAA/bBBB where A’s and B’s indicate 

only two possible single-word answers. Unless speci- 
fically POS/NEG then any positive or negative answer 
is acceptable. 

Group U. LD must specify conditions under which AAM is true. 

If conditions not met, BBBB is true. 

The conditions for specifying truth is done by IF 
statements using GALC forms, e.g.: 

IF 1+1 EQ 4. or CONT IQ FACT(33) AND... etc. 

Group 5. Action frame same as Group constructed response 
except that "+" and are arbitrarily assigned 
answer tags (correct and incorrect). E.g.^, 

+F B: AHEAD (to be done if student is correct) 

-R: REGALCUIATE (to be done if student is wrong) 

(M) The Multiple Choice Frame 

The Multiple -dho ice frame is built in exactly the same way 
in nearly all respects as the Question frame. There are 
only two important distinctions; (l) there are no unanticipated 
responses. PLANIT will require che student to ■”CHCX)SE ONE OF 
THE ABOVE LETTERS." (2) Only the answers bearing lettered 
answer tags will be printed as choices. Numbered answers will 
be executed so that work in GALC may be done but these will 
not be matched with student replies. PHONETIC and KEYWORD 
functions do not apply for multiple -choice frames. The + 
sign is used in the same way as in the Question frame to denote 
the correct answer(s) but will not be printed with the altei^ 

' native answerrchoice in which it appears. Periods may follow 
answer tags for sake of appearance if desirect. E.g., 

A. NORTH AMERICA 
+B. SOUTH AMERICA 

C. AFRICA 

D. EUROPE 
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When the student sees this list the + sign will not appear. 
(D) The Decision Frame • 

Used for decisions based on what the student has done 
across frames. 
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General form: IF, FE^AME #, NUMBERED OR LETTERED ANSWER, 

FEEDBACK, BRANCH. 

These are three general forms for dec is ion- type statements: 

(1) those that are based on clusters of responses; (2) those 
that are based on specific responses; and (3) those that are 
based on the current state of CAI£!. A decision statement 
always begins with IF and usually ends with the commands F: , 

C: , and/or B: . ’C: if used, must be used with a GAKJ state- 
ment. If a statement has no commands, branch to the next 
frame is Implied. Every line must start with an IF, AND or 
OR. No parentheses are allowed to group AND and OR conditions. 
In the following illustrations possible arrangements of the 
decision statements are shown. Vertical columns itemize 
options to occupy that position in the statement. 







IF 

AND 

OR 



Optional entries*** 




GR 






GQ 




RIGHT . 


EQ 


NUMBER 


WRONG 


LGi 


S 


SEEN 


IS 




MINUTES 



FRAME(S)* ) 



AND * 
OR 

COMMAND 



IF RIGHT 
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the search through the records is restricted to those frames the student went 
through after the last occurrence of this decision frame. If used, the. search 
( is restricted to start from the last time that frame was entered. If not found, 
the search starts from the beginning of all frames. 

\ 








O 



ff 







[ 




t 



r 



^ 




\ 

S 



30 October I 967 109 TM-29l4/lOO/00 

(Page 110 blank) 







GR 




- ■ 






GQ 


, 




IF 




Eq 




AND 


AND 


EXH^SSION 


lA 


EXPRESSION 


OR 


OR 


• 


LS 




COMMAND 




1 


Nq 






IF 








AND 


AND 


FUNCTION NAME 


USED 


FRAMES 


OR 


OR 








C0MI4ANt) 




(C) The Copy Frame 










General form C 


N where N is 


frame number or 


label . C N 



means copy frame N. 




30 October 19^7 



111 

(Page 112 blank) 



-1^.291^/100/00 



APPENDIX U 



DESCRB: A LESSON IN DESCRIPTIVE STATISTICS 
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I. INTRODUCTION 



Computer assisted instruction (CAl) is particularly useful in statistics 
courses. The author of such instruction may harness the computer's computa- 
tional power to generate a variety of sample data from population^ with 
specified characteristics. The student may use this same power to reduce or 
eliminate computational drudgery in exercises involving this data. Such use 
of the computer, integrated with tutorial dialogue, is a distinctive feature 
.of the CAI lesson described below. 



DESCRB provides a review or refresher training for the following topics in 
descriptive statistics: empirical frequency distributions, measures of central 

tendency (mean, median and mode) and the variance and standard deviation as 
indices of variability. The lesson was prepared and is executable with the 
PIANIT computer-assisted instructional system,^ operating under SDC's time- 
shared computer system. Teletypewriter terminals located at SDC, or at remote 
locations, are used for two-way communication between users (students or lesson 
authors) and the system. DESCRB presents the student with individualized 
tutorial instruction, pseudorandom sample data for computational exercises, 
and computational assistance (through PIANIT 's CALC mode) for these' exercises. 
Data obtained from trial use of DESCRB by seven college students indtpate that 
,the lesson can be completed in one to two hours of on-line instruction. 



II. PREREQUISITES 



The student should complete the CAI lesson imo^ before beginning DESCRB. 
INTRO builds up the student's skill in using the teletypewriter to communicate 
with CAI lesson material and introduces him to the mathematical conventions he 
must employ in the computational aspects of his subsequent instruction. 



It is also advisable, though not essential, for the student to have recently 
completed a reading assignment in descriptive statistics before he begins DESCRB-. 
The aforementioned students who first tried this lesson read Chapters 3-5 in 



Bobby R. Brown, student associate of System Development Corporation's Education 
and Training Staff during the summer of 19 ^b, is the author of this lesson. 

Mr. Brown is currently a Ph.D. candidate at Pennsylvania State University. 



^lANIT is thoroughly described in: S. L. Feingold and C. H. Frye. User's 

guide to PIANIT. SDC document TM-3055/000/OI, I967. A brief description 
is available in the SDC brochure on PIANIT, BRT-500/003/00. 



^INTRO was written by John Hawkins, student associate of System Development 
Corporation's Education .and Training Staff, during the summer of 1966. A 
student can complete INTRO in 50 to 80 minutes. 
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J. P. Guilford's text"* before beginning. These chapters include all the topics 
covered in DESCRB (as well as some niaterial not included in the lesson). There 
are two "brief references to this text which the. student will encounter during 
his use of the lesson. At the outset he is asked, in the form of a printed 
message from the teietypewnriter, whether he has completed the assi^ed reading 
in Guilford. (He is -permitted to continue the lesson in any case.) Towards 
the close of fiESCRB the student is referred to page 83 of the text for a 
derivation of the raw score *form of the variance formula. The lesson can be 
easily edited to replace these references with others, for students using a 
different textbook. 






Note: The student should also be furnished copies of the figures shown on 

pages 122 and 123 of this appendix. The lesson poses questions about 
these graphical illustrations which the student is required to answer 
via the telet^’pewriter. 

III. OBJECTIVES 

The lesson objectives are "two fold: First, in descriptive statistics the 

objective is to provide a review of 1 the most important elementary aspects of 
descriptive statistics for univariate data. The student who completes the 
lesson should have become familiar with the data classification and tallying 
procedures antecedent to the construction of histograms and frequency polygons. 
He must also exhibit competence in reading and intei^reting such representations 
of sanrole data frequencies before progressing to instruction on measures of 
central tendency and variability. For the latter, the student’s work is checked 
and guided (in computational exercises) until he exhibits an ability to compute 
correct values for the various measures, applying their definitions and/or 
corr5)utational formulae to sample data. 



A second objective is to continue the student's introduction to the use of 
PIANIT's CALC mode for-on-line computation which was begun in the lesson INTRO. 
The con^iutational exercises in descriptive statistics thus have a dual purpose. 










IV. LESSON DESIGN 

The general pattern for each block of instruction is to present the subject 
information in a tutorial mode, followed by question-answering diagnostic 
sequences and, finally, computational exercises which use and amplify upon 
the subject matter. When the student’s response indicates mastery of the 
subject matter, the lesson moves him forward to the next block of instruction. 
We will now describe the content and sequencing of lesson subject matter,^ 
followed by a discussion and examples of instructional presentation techniques. 



''j. P. Guilford, Fundamental Statistics in Psychology and Education (4th edition). 
' McGraw Hill Book Co., New York, 1965* . 
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A. ORGANIZATION 

The subject matter of lesson DESORB is logically organized under three major 
topics of descriptive statistics: 

. Frequency Distributions 

. Measures of Central Tendency 

, Indices of Variability 

The following outline shows the order in which subtopics and teaching points 
within the major topics are introduced by the lesson. However, all students 
will not see the subject matter in the same detail. This will become apparent 
later. 

1 , Content Outline 

Constructing and Using Frequency Distributions: 

, Usefulness of ordering and grouping data. 

. Concepts of "class intervals" and "frequency distribution." 

• Derivation of frequencies; interval limits and tally marks. • 

. Two guidelines for setting up intervals. 

. Three steps in setting up intervals 
. Determining the range of data. 

. Choice of interval size 

. Determining start point of the lowest interval. 

. Concept of "exact limits" of intervals. 

. Implications from frequency distributions 

f 

. The "crude mocfe" as a most typical score 

• Shape of a distribution of test scores as indicative of test 
difficulty level. 

. 

. Graphical representation of frequency distributions 

' •V< 

• Using a histogram 

■'S. dl 

. Using a frequency polygon. 
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Measures of Central Tendency 

. Definitions of "mode," ’’median," and "arithmetic mean." 

. Determining the median value in a sample. 

la. 

Determining the modal value in a san^le. 

5 

. Introduction of CALC functions and expressions for student use. 

S(X) = sum of column X 
SS(X) = sum of squares of column X 
N(x) = number of scores in column X 
S(X)/n(x) = mean of column X 

(SS(X)-((s(x)**2/n(X)))/n(x) = variance of column X 

. Computing the mean of a sample --student uses S(x)/n(x) or equivalent. 

. Computing the overall mean of two combined san5>les— student uses 
(S(1)+S(2 ))/(nU)+N( 2)) or equivalent. 

• Computing the "sum of row products" of two samples --Introduce student 
use of SRP function. 

. Computing "sum of squared differences" of two samples— Introduce use 
of SSD function. 

. Property of the mean; deviations from sample mean always sum to zero. 

. Comparing summed deviations from the mean with summed deviations 
from an arbitrary point in a sample. 

Indices of Variability 

. "Central tendency" versus "variability"; need for a concept of 
variability. 

. Comparing usefulness of "range" with "variance" and "standard 
deviation. " 



^The reader is referred to pages 126 and 127 of the section entitled Computational 
Exercises for a discussion of the students’ use of these functions. 
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• Computing the variance of a sample from precomputed deviations-- 
student uses SS(x)/n(x) or equivalent. 

• Computing the standard deviation of a sample from precomputed 
deviations— student usea SQRT(SS(X)/n(X) ) or equivalent. 

• The effect on "variance” when deviations are measured from points 
other than the mean. 

• Minimum value for sum of squared deviations occurs when deviations 
are measured from the mean; the "least squares" property of the mean. 

. Computing the variance directly from raw scores — student uses 
(SS(X )-( (S(X)**2 )/n(x).) )/n(X) , or equivalent in discrete steps. 

• Computing the standard deviation from raw score variance--student 
uses SQRTCyariance value) or equivalent. 

• Con^aring variance and steuidard deviation values computed from raw 
scores with the same indices computed from deviation scores. 

• Conparing usefulness of raw score and deviat ion-from- the -mean formulas. 

• Introduction of two new GA.LC functions for student use 
. M(x) for mean of sample data in column X 

• SSM(X) for sum of squared deviations from mean of sample data in 
column X 

• Computing and comparing the mean of two samples, using the M(x) 
function, 

• Computing and comparing the standard deviations of two samples, 
using SQRT(SSDM(x)/n(x)) or equivalent. 

2, Lesson Structure 

Figure 1 is a flow chart of lesson DESCRB, It shows the sequential development 
>of subject matter, major decision points in the lesson, and sequences of remedial 
or review instruction. The descriptive phrases in Figure 1 are appended with 
frame numbers (in parentheses) to aid in locating information in the lesson, or 
in a lesson printout,^ 



complete lesson printout is beyond the scope of this document. Should the 
reader require a copy, contact Dr. Harry F. Silberman, System Development 
Corporation, 2500 Colorado Avenue, Santa Monica, California 904o6. 
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1. Enter lesson (0-3) 

2. Student confident of entry knowledge? (l-3) 

3. Can student pass entry test? (4-9) 

4. Class Interval and frequency distri- 
bution (10-17) 

5. Guidelines for setting-up intervals (l8-20) 

6. Setting up a frequency distribution (21-24) 

7. Questions on frequency distribution (25,26) 

8. Exact interval limits (27) 

9» Crude mode and shape of distribution (28-30) 

10. Does student have handout sheets? (3I) 

11. Student gets handouts from instructor 

12. Can student use frequency table? (32) 

13. Remedial instruction (33,34) 

14. Student still having trouble? (33) 

15. Student gets help from instructor 

16. Using a histogram (35) 

17* Can student use frequency polygon? (36) 

18. Remedial instruction (37) 

19. Define mode, median and mean (38,39) 

20. Determining medians (39»5-39.8) 

21. Determining the mode (39.9) 

22. Bi-modal and uni -modal data (39*95) 

23* Introduce CALC functions (40,4l) 

24. Computing means (41.3-43 and 47.5-51) 

25* Remedial on use of CALC (44-47) 

26. CoB5)uting exercises (51*3-51*4) 

27* Sum of deviations from mean (52-59) 

28. Indices of variability (59-84) 

29* Cor5)uting variance (65,66) 

30. Computing standard deviation (67) 

31* "Least squares" property (68-72) 

32. Coiii5)uting raw-score variance (73) 

33* Variance correct? (73) 

34. RemedieLL exercise (74-77) 

35* Computing raw-score standard deviation (78) 
36. Conq)are raw-score and deviation solutions 
(79i80) 

37* M(x) and SSDM(X) functions 
38. Confuting means (84-86) 

39* Computing standard deviations (86-86) 

40. End of lesson (89) 



Legend; Enter/exit lesson 



Interactive instruction 
and exercises 



O Lesson decision ^ Lesson frame numbers 



i i 

! W 



Figui^ 1. Lesson DESCRB Flo\/ Chart. 
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Now, with reference to Figure 1: 

• Upon entering lesson DESCRB, the^student is asked if he has read 
material from the assigned text, ' if he Imows what a frequency 
distribution is, ahd if he can construct a frequency distribution. 

If he answers NO to the latter two questions, the lesson gives him 
instruction on how to set up frequency distributions (items h and 5). 
Otherwise, he is tested on his knowledge of class intervals and ^ 
frequency distributions. If he passes the test (item 3), the lesson 
presents exercises in setting up and reading data from frequency 
distributions (beginning at item 6). Otherwise, the lesson presents 
the preliminary instruction noted earlier. 

. Instruction on the graphical representation of frequency distributions 
requires that the student refer to prepared, handout sheets. The 
student is asked if he has them (item *10). If not, the lesson advises 
him to obtain them from the instructor. Because subsequent questions 
relate specifically to this material, the lesson will wait until the 
student types YES before proceeding. The handouts, which contain 
fictitious data, are shown in Figures 2 and 3.. The frequency distri- 

■' bution of language test scores is put on a separate page from the 
other two figures, because the lesson advises students not to look at 
the frequency distribution when using the histogram and frequency 
1) polygon. ... 

. If the student’s responses indicate that he is not able to use the 
frequency distribution handout, he is asked to locate a specific 
interval on the figure. If he can't find that interval, the lesson 
advises him to seek help from his instructor. It may be that he 
doesn't have the appropriate handout, or that he is looking in- the 
wrong column. The lesson will wait at this point (item l4) until the 
student types YES# 

. When the student can successfully read data from a frequency polygon 
(items 17 or 18), the lesson begins instruction on measures of central 
tendency (items 19 through 27)# The student must next demonstrate his 
ability to use the CALC functions made available to him, by computing 
means of single samples and a combined mean of two samples. Then the 
tutorial exercises are extended to include computing a sum of row 
products, a sum of row differences, and a combined sum of row products 
plus a sum of row differences plus the sum of a column of data. In all 
of these exercises, if the student . fails to obtain correct numerical 
results after several attempts, the lesson will finally print recommended 
expressions for the student to use in his computations. After that, 



"^0£. £it. , Guilford (Chapter 3 j Frequency Distributions). 
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Table A. Frequency Distribution of Scores on a Language 

Test for 100 Freshman Girls, 



Interval 


Frequency 




90-99 


1 




80-89 


3 




70-79 


6 




60-69 


22 




50-59 


24 




40-^9 


20 . 




30-39 


16 




20-29 

10-19 


8 




0-9 


1 





■i 



\ 

\ 



\ 



\ 




Figure 2, DESORB Handout — Page 1. 
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Figure A* Histogram for data of Table A* 
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Figure B. Frequency polygon over histogram. 
Figure 3 * DESCBB Handout— Page 2 . 
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the student must only observe the designated ^>^^8 

the desired ansver. If the student's answer ^ntLlIl exeroisf 

trouble on the first computational exercise, a special tutorial exerol. 

Utem asr^h^s the studLt how to use a Motion for computing a 

sample mean with PIANIT’s GA.KJ mode. 



Flnallv the lesson presents exercises which are designed ;^o portray an 

samnle mean for a presented set of scores, using CAM for this pus^ 

C "L^on" tten presents the set of deviations of these scores from 
ttelr and the student sums the set. The process is repeated when 

the student furnishes an arbitrary number between 5 and 15 
aflLd to his computed sample mean; new deviations are computed for the 
Snt ufing trorLina? scores, but their deviations are now manured 
from a point in the sample other than the mean. The student asked 
to con5)are the various summed deviations. 



To introduce the need for Indices of variability (item 28), DESCKB asks 
the stodent to compute the means of two samples and 

4-v.o mAftns are Quite similar, the samples are clearly different. Again, 
as with measures of central tendency, the student must demonstrate in 
tutorial exercises that he can compose mathematical expressions, for 
InnufS the ^IC mode, to obtain numerical values for sample -^riances 
and standard deviations that are based on deviations from a sample mean. 

IS exe“Sr (Sim 31), similar to that for item 27, la used to dencn- 
SrSrSr"least Squares" property of the mean ^he stude^ obta^s 
and compares two variance values, one based on deviations irom a s^ple 
mean and another based on deviations computed from an ^ 

in the sample. Subsequent exercises (item 32) require the use 

raw score formula to compute variance. If ® " emression 

the student is having trouble with the composition 

for the raw score variance formula, a step-by-s ep ^ score" 

(item 3h) is presented. The student then compares his raw score 
numerical results with the variance and standard deviation °d taine c, 
for identical- sample data, using deviations from the “ean. y, 

R-^udent is fziven. two very simple CALC expressions (item 37)^ 
he subsequently use^ to compute and compare means and standard deviations. 



B. FORM OF PRESEMATION 



This section focuses on characteristics of 'the lesson s tutorial style, 
covers computational exercises. 








^ 
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1, Tutorial Interaction 

Lesson DESORB uses a tutorial style of presentation In teaching new subject 
matter to students, In remedial and review se<iuences, and In all computational 
exercises. Student responses are continually evaluated and immediate feedback 
' to the student is provided. Feedback for both correct and incorrect responses 
is generally c[uite brief j for example , NO, TRY AQIA.IN or VERY GOOD, YOU RING THE 
BELL.^ On the other hand, incorrect student res-ponses or response patterns can 
cause the lesson to activate i*emedial seQ.uences where the interactive dialogue 
becomes more substantial. 

Student responses anticipated and prompted by DESORB are of several types, all 
quite short. Most of the questions that require a non-numerical response 
expect either a simple yes/no answer or the completion of a sentence by 
supplying the missing words. All of the computational exercises ultimately 
require the student to submit his answer in numerical form, either integer or 
decimal. (Students may obtain their numerical answers by inspection of data, 
by hand calculation, or by, use of PIANIT's GALO mode.) Because each student's 
solution to computational exercises dealing with measures of central tendency 
and variability will be matched against a value in CALC, the lesson author has 
attempted to develop, in the student, the habit of responding numerically 
rather than with words. For the initial instruction on frequency distributions, 
each student's response that is formed as the verbal equivalent of a correct 
numerical answer is also accepted as correct, but the student is advised to 
submit subsequent answers in numerical form wherever possible. Thereafter, 
those frames which expect a numerical answer do not accept an -equivalent verbal 
entry. 

Example A, page 133, shows a tutorial sequence .from lesson DESCRB. The student 
is to compute the mean of a column of scores, but forgets how to enter the GAIC 
mode to input an expression for numerical evaluation. The lesson diagnoses the 
problem and provides remedial help to the student. 

2. Computational Exercises 

After completing instruction on frequency distributions, the remainder of 
DESCRB, dealing with measures of central tendency and variability, uses tutorial 
exercises for demonstration and con^utational practice. The student i's presented 
one or more columns of sample data, assumed to represent scores like those on 
an achievement or ability test. ' The samples are presented to reinforce and 
supplement points made by the instructional text. Sometimes the sample data 
alone are sufficient, but most often the point is further demonstrated by requiring 
the student to perform calculations on the data, and/or by comparing different 
computational forms yielding the same numerical result. 



q ■ ■ ■" ■ ■ ■ 

°In this case, to emphasize the feedback statement, the lesson author actually 
.caused the teletype bell to ring repeatedly as a part of the feedback. 
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The saarple data for each exercise is either fixed in the lesson, such that it 
is always the same for all students, or is the result of a pseudorandom number 
generation process under control of, the lesson. In the latter case, whic51i 
Includes 8 l 11 exercises on the mean, variance and steuidard deviation, the data 
presented will be different for each student. The data will also be regenerated 
whenever the lesson causes a given student to re-enter an exercise already 
performed. It can be seen, therefore, that the correctness of a student's 
numerical answer for the random data exercises cannot be evaluated by matching 
against a value pre-computed by the lesson author. Instead, answer matching 
is accomplished by author-defined functions, used in anticipated answer sets 
in lieu of numerical values. During lesson execution, PIANIT’s CALC mode makes 
use of these functions to calculate anticipated answers, based on the actual 
data that each student is using in an exercise. More detail on the generation 

of sample data and use of PIANIT's CALC mode for answer matching is presented 

in Part V, "Teclmical Discussion." 

To students, the exercise data in DESCRB takes one of the following forms, 
depending on the nature of the exercise: 

. A single column of scores. 

. Two columns of scores. 

. One column of scores and another of deviations from the mean of 
the first column. 

. One column of scores and another of deviations from a value within 

5 to 15 score points of the mean of the first column. 

i 

For each one- or two-column» sample presented, the student is asked to make 
certain calculations pertaining tO' measures of central tendency and variability 
(noted earlier, pages 121 and 124). The lesson informs all students of the 
junctions available to them in PIANIT's CALC mode. They are as follows: 



. S(X) ... sirni of column X 
. SS(X) ... sum of squares of column X 
. N(X) ... number of scores in column X 
. SSD ... sum of squared differences between two columns 
. SRP ... sum of row products* from two columns 

. SQRT( ) ... square root of any value or arithmetic expression 

enclosed in parentheses 

. M(x) ... mean of column X 

I . SSDM(X) ... sum of squared deviations from the mean of column X 



..ERIC 
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It Is assumed that the student has been oriented to the use of tue first two 
functions and the standard arithmetic operators in lesson INTEO. Tnerefore, 
the S(x) and SS(x) functions are merely reviewed by DESORB. The remaining 
functions are then introduced by DESORB as needed for subsequent exercises; 

N(X) prior to computing means, SRP and SSD just before introducing the concept 
of deviations from the mean, and SORT as part of exercises on computing the 
standard deviation. The M(X) and SSEM(X) functions are introduced only after 
the student has already practiced composing expressions equivalent to these 
functions. 

In a few of the exercises, it is sufficient for students to use one of the 
functions alone to arrive at a numerical solution; e.g. , SRP or M(X). How- ^ 
ever, most of the exercises req.uire that students either; 

. Combine the functions into a single expression which will yield a 
numerical result in one operation; e.g., S(1)/n(1) for the mean of 
column 1, SSDM(2 )/n( 2) for the variance of coluinn 2 

or 

. Perform the calculation in separate steps; e.g., even though the 
student could compute a variance from raw scores in column 1 using 
the expression (SS(l)-( (s(1)**2/k( 1) ) ^ he might prefer to find 

the variance in three steps- 

•. S(1)^2/n(1) 

. (ss(l) )-( value from first step) 

, (value from second step)/w(l) 

The tutorial approach used in the exercise frames is to encourage the student 
to obtain numerical results from single expressions, suggesting the step-by- 
step methods only if the student cannot successfully combine the functions. 
Example B, page 139; shows a representative computational exercise from DESCRB. 
In this case, the problem for the student was to first compute a mean ’/alue 
for each of two columns of scores,, where column 1 is a sample from a nor.nal 
distribution and column 2 is a sample from a re-ctangular distribution. After 
noting the similarity between means , the 'lesson generated a new coj.umn of 
scores and a column representing deviations from the mean of those scores. 

The student v/as then instructed to compute the ^/ariance and standard deviation 
of "the scores in column 1, using the deviations from column 2. 
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V. TECHNICAL DISCUSSION 
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We will now elaborate on techniques used by the lesson author to manipulate 
sample data for exercises, define computational functions for use by students 
and in lesson frames, ° and determine whether the students' numerical answers 
are correct or incorrect. The reader who is not already acquainted with the 
capabilities of Problem Frames and the CALC mode of PLANIT^^ may wish to skip 
this section. 

Population parameters governing the generation of sample data for computational 
exercises were specified in PIANIT Problem Frames. In these frames the author 
also specified sample size limits and printing formats for the data accompanying 
each exercise or series of exercises. ’ As a reseat, the sample data in DESCRB 
is generated according to the specified population parameters, where the 
distribution of the population is either normal or rectangular. There are from 
eight to fourteen data entries pseudo randomly generated by the computer from 
the specifications for each sample. Format specifications in each Prol?lera 
Frame set up the header titles and spacing between columns of data for teletype 
printout. 

PIANIT automatically places the pseudorandom data into two identical matrices 
called VALUES (for use by the lesson) and DATA (available for manipulation). 

The number of rows in these matrices is determined by the sample size and the 
number of columns by the distribution (univariate or bivariate) specified by 
the lesson author in each Problem S^rame of DESCRB. For example, if the frame 
calls for a one-column (univariate) sample of size N, VALUES and DATA each 
become N x 1 arrays, i.e., matrices with N rows and one column, or N x 2 matrices 
for two-column (bivariate) samples. 







Each time that a Problem Frame specifies sample data for the matrices VALUES 
and DATA, the author has used CALC statements in lesson frames^^ to store an 
image of that data in a fixed .diniension matrix (20 x 2) called FLIP, defined 
at the beginning of the lesson. To do this, the lesson author has defined the 
contents of FLIP as follows: 

FLIP (1,1) DATA(I) F0R(I = 1," N(1)) 
for one-column samples, and 



Q 

The subset of functions available to students was noted earlier under 
Computational Exercises, page 126. 

^^Qp. clt . , Feingold and Frye (pages The Problem Frame, and pages 5^4--79^ 

- The CALC Mode). 




Feingold and Frye (page 51^ Using CALC Statements in the Frame). 
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FLIP (I,X) = DA-SACI^X) F0R(I = 1, N(X) X = 1,2) 
for two-colujnn samples. 

The number of observations in each column of data are put, by PIANIT, into a 
two-element array, called N such that N(l) becomes an acceptable way of desif^- 
nating the number of observations in column one and N(2), in column two. 

Normally, some of the higher numbered entries of FLIP remain unused since none 
of the sample sizes reach twenty. 

The reader may be interested to know why a 20 x 2 matrix called FLIP was used, 
since FLIP is not -one of the basic PIANIT components. FLIP was used to facili- 
tate the writing of 'a unifomn list of statistical functions that were made 
available to the student. They are uniform in the sense that they are iden-bical 
in composition and use for each data manipulation problem of the lesson. Since 
some of the problems use two groups of data and others use only one, the PIANIT 
matrices, VAUJES and DATA, will vary in their column dimensions from two to one. 
However, functions that operate on the data must reference the matrices according 
to their defined format; they must include two subscripts after a t-^-ro- dimensional 
j_x ^ but only one after a one -dimensional matrix. If the functions are to be 
completely uniform and not vary in their composition for univariate and bivariate 
problems, then the data must also be kept in a matrix whose diemsnions do not 
vary. FLIP is such a matrix. By making all functions refer to FLIP, it is 
necessary for the lesson to immediately transfer any newly generated data into 
it. The lesson does this by using one of the statements noted above. Since all 
of the functions are written in such a way that they operate on the entries of 
FLIP, the composition of the functions do not vary throughout the lesson. The 
functions are defined as follows: 

. S(X)=SUI.1 FLIP (I,X) FOR (l=l, N(x)) 

. SS(X)=SU14 FLIP (l,X)*FLIP (l,X) FOR (l=l, N(X)) 

. m(x)=s(x)/n(x) 

. SD=S(l)-S(2) 

. SSD=SIJI>1 (FLIP(I,1)-FLIP(I,2))**2 FOR (l=l, H(1)) 

. ssdm(x)=sum sum (flip (i,x)-j)->^2 for (1=1, N(X) J=^«1(X') 

. v(x)=ssm(x)/ii(x) 

. STD(X)=SQRT (v(X)) 

. SRP=SUM FLIP (I,1)*FLIP(I,2) FOR (l=l, N(1)) 
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Thus by using FLIP, a matrix vith static dimensions, to hold the sample data, 
the functions as defined above remain ’<mlid throughout the various kind^ of 
problems, whereas the dimensions of VALUES and LATA may change with each 
execution of a Problem Frame. 

> 

/ 

All of the above functions, with the exception of SD, V(X) and STD(X) are ^de 
available to students at various points in the lesson. To obtain numerical 
solutions using PIANIT’s CALC mode, the student must often compose and type in 
expressions consisting of one or more of these J^ctions, arithmetic operators 

and other symbols; e.g., 

The lesson author incorporated all of these functions into numerical answer 
lists of the lesson as a way of denoting correct and anticipated wrong answers 
to the various exercise questions. The use of functions, rather than absolute 
numerical answers, was necessary because each student receives different sample 
data for exercises. For example, in the answer list accompanying an exercise, 
the author specified such expressions as 

s(i)/n(i) within .5 

for the mean of column 1 data, or 




SRP WITHIN .5 

1 

for the sum of row preducts obtained from two columns, or 
S(2) WITHIN .5 

for the sum of data appearing in column 2. 

Assume for a moment that the answer list for a given lesson exercise contone d 
both S(l) and S(2) as anticipated answers, and the student was to FIND THE SUM 
OF COLUMN 1". Then if the student's numerical answer matched the computer s 
calculation of S(2), based on the currejnt contents of the FLIP matrix, the^^ 
lesson could come back with "NO, I SAID THE SUT4 OF C0LU14N 1, NOT COLUI^IN 2. 

In summary, this section has briefly covered how frames in lesson DESCRB are 
used to: . 



^^he ♦” and t symbols, respectively, are used by the student to enter and exit 
PLA.NIT's CALC mode. For example, the student might enter ♦-S(1 )/n( 1/ with 
reference to some . specif ic data. After receiving the numerical solution for 
the mean of column 1 scores, say ^9*50^ he would type '^^9*5 to enter his 
answer. This reuld return him from CALC to a lesson frame, where his answer 
3 could then be c/aluated as correct or incorrect. 
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data for exercises; 

• define computational functions for use by students and by PIAIIIT; 

• determine whether student numerical answers are correct or 
incorrect. 
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VI. EXAIvJ^IE A 



Tutorial Mode 



Illustrates the tutorial mode of presentation 
in a remedial sequence on how to enter PIANIT's 
CALC mode and compute the mean of a column of 
scores. 

Lesson DESCRB, Frames ^3-00 through ^7 •00* 




I 
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Example A --Lesson Printout 



FRAME 43.00 C0) 

02^ TEXT* 

WHAT IS THE MEAN OF THE COLUMN OF SCORES ABOVE? 

G3* ANSWERS* 

1+ SCD/NCl) WITHIN *5 
A S( 1) 

?^F*^VERy'^600D. you just bypassed A RATHER BORING REVI EW*E:AHEAD 

-Fi LET'S REVIEW A BIT* 

A Fl LET'S REVIEWA BIT* 

- Ft LET’S REVIEW A BIT* 



FRAME 44*00 CM) _ 

^TYPE IN THE LETTER ASSOCIATED WITH THE FIRST STEP YOU WOULD 
' TAKE IN ORDER TO HAVE THE COMPUTER FIND THE MEAN OF THIS 
SET OF DATA FOR YOU* 

G3* ANSWERS* 

A+ ENTER 'CALC 
B+ TYPE •• 

C SUM THE SCORES 
D TYPE 'SC 1)/NC 1 > ' 

G4* ACTIONS* 

AB Ft BtB4 
C BtB5 
D BtB6 



FRAME 45*00 CM) LABEL® B5 



^perhaps YOU DID NOT READ THE RUESTION CAREFULLY* IF 
GOING TO COMPUTE THE MEAN BY HAND THE F IRST 

THF SCORES* HOWEVER THE RUEST ION ASKED FOR IHii, FIRST STEP YOU 
wSy ?AkI TO Ha5e y COM^^ find THE MEAN FOR YOU. WHAT ACTION 

DO YOU TAKE TO PREPARE THE COMPUTER TO DO CAI^CULA.ION^? 



G3* ANSWERS* 

A* ENTER 'CALC 
B+ TYPE ^ 

C SUM THE SCORES 
D TYPE 'SCD/NCO' 



G4* ACTIONS. 

AB Ft THAT'S RIGHT* B.tB4 
CD Ft NO* BiB4 



I 
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ExanjJle A— Student Printout 

WHAT IS THE MEAN OF THE COLUMN OF SCORES ABOVE? 



♦I*M NOT SURE WHAT TO DO FIRST 
LET’S REVIEW A BIT. 

TYPE IN THE LETTER ASSOCIATED WITH THE FIRST STEP YOU WOULD 
TAKE IN order TP HAVE THE COMPUTER FIND THE MEAN OF THIS 
SET OF DATA FOR YOU. 

A ENTER ’CALC’ 

B TYPE » 

C SUM THE SCORES 
D TYPE ’SCD/NCU’ 



♦ C 



I 







I 

I 

I 



PERHAPS YOU DID NOT READ THE QUESTION CAREFULLY* IF YOU WERE 
GOING TO COMPUTE THE MEAN BY HAND THE FIRST STEP MIGHT BE TO SUM 
THE SCORES. HOWEVER THE QUESTION ASKED FOR THE FIRST STEP YOU 
WOULD TAKE TO HAVE THE COMPUTER FIND THE MEAN FOR YOU. WHAT ACTION 
DO YOU TAKE TO PREPARE THE COMPUTER TO DO CALCULATIONS? 



A ENTER •XALC’ 

B TYPE - 
C SUM THE SCORES 
D TYPE ’SCO/NCD’ 








♦ D 
NO. 



ConmentB 

The student was presented, with a column of 12 socres in a prior frame and now 
is asked, to compute a mean value for the scores. The correct stu(tent response 
is specified in Group 3 of Frame 43.00 as the esqpression S(1 )/n( 1) WIT™ .5. 
PIAWIT will cedculate the mean, using this e:^ression, and the student ® . 

numerical answer will be compared. As can be seen from Group 4 of Frame 43. 
any answer other than the correct numerical value for the mean, causes the 
student to enter a remedial sequence (Framb^ 1A.00 throu^ 47.00). 



Our student didn’t attempt to calculate the answer, but indicated an uncertainty 
on how to proceed. Because of his next answer at Frame 44.00, that fra^ 
directed him to Frame 45.00 (labeled B5). Note that Frame 44.00 mi^t have sent 
him to Frames 46.00 or 4?.00 (b4 or b 6, next page) depending on his answer. 
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Example A--Lesson (cont'd) 



FRAME 46*00 (M> LABELa B6 

G2. TEXT* . ' 

YOU HAVE ANTICIPATED THE NEXT STEP# BUT YOU HAVE OVERLOOKED 
A COMMAND WHICH MUST BE SENT TO THE COMPUTER BEFORE TYPING *£(1)/N(D'. 
TRY AGAIN. 

63* ANSWERS. 

A+ ENTER *CALC* 

B+ TYPE •* 

C SUM THE SCORES 
D TYPE *SC 1 )/NC 1 ) * 

64. ACTIONS. 

AB F:THAT*S RIGHT. B:B4 
CD FiNO. BtB4 



FRAME 47.00 CO) LABEL* B4 
G2. TEXT. 

YOU MUST ENTER CALC BEFORE USING ANY OF THE BUILT IN FUNCTIONS. 
YOU CAN ENTER CALC BY TYPING RECALL THAT SCI) IS THE BUILT IN 

FUNCTION FOR THE SUM OF COLLMN 1# AND NCD IS ECUAL TO THE NUMBER 
OF SCORES IN COLUMN 1* A VERY EASY V.AY TO COMPUTE THE MEAN IS TO 
ENTER CALC AND TYPE •SCD/NCD*. 

\ 

FIND THE MEAN OF THE SCORES IN EXAMPLE 1. 

63. ANSWERS. 

!♦ SC 1 )/N( 1 ) WITHIN .5 

64* ACTIONS. 

1 Fi 

-Rl NO. TRY AGAIN. 
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VII. EXAI-IPLE B 



Computational Exercises 

Illustrates sample data generation, student's 
use of CALC functions in computation, and lesson 
author's use of CALC functions for evaluation of 
student's answers. 

Lesson DESCRB, Frames 59«00 through 67.00. 
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Example B--Lesson Printout, 



frame 59.00 <0 

G2. text. 

SO WHEN DE,VIATI0NS ARE TAKEN FROM THE MEAN THEY SUM TO 0.0. 
DEVIATIONS FROM ANY OTHER POINT WILL NOT SUM TO 0. 

\ 

THE MEAN TELLS US SOMETHING ABOUT A SET OF SCORES# BUT JUST 
KNOWING THE MEAN-LEAVES^ MANY ©UESTIONS UNANSWERED. IN THE 
FOLLOWING SCORES YOU WILL OBSERVE THAT THE MEANS OF THE TWO COLUMNS 
ARE QUITE SIMILAR# BUT THE TWO SETS OF SCORES ARE OBVIOUSLY 
DIFFERENT. 



FRAME 60.00 CP) 

G3. OPTIONS. 

ALL 

G6. STRUCT. /STUD. PREF. 
T N 



G7. DIST. 

NR 

G8. Ml R1 SI N1 MS- R2 S2 N2. 
80 10N 14 0 100 N 14 

G9. header. 

ITEM NO. COL. 1 COL. 2 

V V V 



FRAME 61.00 CO) 

G4. actions. 

Ct FLIPCI#X>>DATA(I#X) F0RCI«1#NCX> X«l#2) 



FRAME 62.00 CO) 

G2. TEXT. 

WHAT IS THE MEAN OF COLUMN 1? 

G3. ANSWERS. 

1+ SCD/NCl) WITHIN .5 

G4. ACTIONS. 

1 F:GOOD. WHAT IS THE MEAN OF COLUMN 2? 

-R* NO. THE MEAN OF COLUMN 1 PLEASE. TRY AGAIN. 



o 

EKIC 













ERIC 
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Example B--Student Printout 



so WHEN DEVIATIONS ARE TAKEN FROM THE MEAN THEY SUM TO 0.0* 
DEVIATIONS FROM ANY OTHER POINT WILL NOT SL-M TO 0» 



THE MEAN TELLS US SOMETHING ABOUT A SET OF SCORES# BUT JLST 
KNOWING THE MEAN LEAVES MANY QUESTIONS UNANSWERED. IN THE 
FOLLOWING SCORES YOU WILL OBSERVE THAT THE MEANS OF THE TWO COLUMNS 
ARE QUITE SIMILAR# BUT THE TWO SETS OF SCORES ARE OBVIOUSLY 



different. 






llEiA NO. 


COL. 1 


COL. 2 


1- 


78 


52 


2- 


81 


77 


3- 


78 


42 


4- 


80 


82 


5- 


79 


• 116 


. 6- 


80 


1 17 


7- 


8i 


58 


8- 


76 


12.1 


. 9- 


7B 


77 


10^ 


80 


31 


! 1- 


79 ^ 


79 


12- 


81 


1.19 


13- 


81 


70 


14- 


80 


86 


V.HAT IS THE 


MEAN OF 


COLLMN 



♦►SC 1)/NC 1) 
79.A286 



■C t79.4286 

GOOD. WHAT IS THE MEAN OF COLUMN 2? 



Comraents 



The student has' Just finished exercises on v\casures of central tcndcnc:^' ai. ' /.as 
compared the sum of deviations from a mean \;ith the sum of aeviations .uro: . an 
arbitrary point. He is now being introc^uced to the concept of \^riacility. 

Frame a Problem Frame, calls for PIAinT to produce a two-colum.m sample 

with Ik entries in each column. The sai.’.ples arc to be generated fro:n the ^ 
normal distribution with mean 3o and standard deviation of lO/o for thc^ first 
column, and for the second column from the I’cctangular distribution witn 
identical mean and range 100. The specifications are contained in G.o, d.7 and 
G.8 shown on the left. The spacing betvieen columns of data is specified with 
G.9« The statement ”AI(L" in G.3 denotes that all functions defined oy tne 
lesson author are to be made available to the student.' Frame ol.p0 tnen causes 
PIANIT to fill the FUP matrix with the sample values in DATA, so tnat function 
which make use of FLIP can now be used by the student and by PIAHIT (sec Part 
Technical Discussion, for further details). 



« 

The student is now asked to compute the mean of colui'ui 1. He enters CAK) u'itn 
the appropriate function, then enters his derived answer for es^aluation. His 
answer is correct and he is asked to compute the mean of coluim f. 



r-p:rjsr-Jie«cir*" 
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Example B- -Lesson (cont'd) 



FRAME 63*00 


CG) 


G3* ANSWERS* 




1+ SC2)/NC2) 


WITHIN 


G4* ACTIONS* 




1 Ft 




-Rl NO* TRY 


AGAIN* 


FRAME 64*00 


CG) 



VIE OFTEN WANT TO KNOW HOW MbCH VARIABILITY IS DEMONSTRATED 
BY A SET OF SCORES* WE COLLD LOOK AT THE kAN&E# BLT EECALSE THE 

RANGE IS. DEPENDENT ON ONLY TWO SCORES IT I ^ f.pjApiLlTY WHICH 

INDICATOR OF VARIABILITY* WE NEED A MEASLKE OF VARIABILITY WHICH 
}s BASED ON ALL THE SCORES RATHER THAN ON THE TWO EXTREME SCORES. 
^EvIrAL SUCH mLIl RE? EXIST. V.E ULL LOOK AT THE MOST IMPORTANT 
OF THESE# THE 'VARIANCE' AND THE 'STANDARD DEVIATION * 

\ 

type go WHEN YOL ARE READY TO GO ON* 

G3* ANSWERS*’ 

A+ GO 

G4* ACTIONS* 

A. Fs OK# HERE WE GO*. 

-Fs OK# HERE WE GO*-, 

FRAME 65*(?'0 CF) 

^ O *T* F y T 

LET'S GENERATE ANOTHER COLLMN OF SCORES AND A COLl.MN OF 
DEVIATIONS FROM^ THE MEAN*\ 

SCORES ,DE\/IATIONS\ 

G4* ACTIONS* 

Cl RESET <VALLES#P#8) 

Cs VALLLSCI#!) «= TRL NCATE < RANDOM* 1 OE ) FOR <I=l#f) 

Cl FLIP(I#1)= VALLLSCI#!) FORCI=l#P) 

CiMEAN s SC1)/N(1) 

Cl VALL'ESC !#?)= VALl ESC I # 1 ) -MEAN FORCT=l#&) 

Cl4 PLACES 

FRAME 65*3P CP) 



G9* HEADER* 
ITEM COL* 
K X 



COL* ? 
X*XXXX 



FRAME 6S*50 CD) 

G2* CRITERIA* 

ClFLIFCI#S)=VALUESC I#2) FOR CI=1#B) 






ii 
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Example B— Student (cont*d) 



♦ •■<S(2)/N<2) 

CLOSING PARENTHESIS MISSING. 

*«-SC2)/N<2) 

80*50 

♦t80*50 1 

FINE. 



WE OFTEN WANT TO KNOW HOW MUCH VARIABILITY IS DEMONSTRATED 
BY A SET OF SCORES* WE COULD LOOK AT THE RANGE# BUT BECAUSE THE 
RANGE IS DEPENDENT ON ONLY TWO SCORES IT IS NOT A VERY GOOD 
INDICATOR OF VARIABILITY* WE NEED A MEASURE OF VARIABILITY WHICH 
IS BASED ON ALL THE SCORES RATHER THAN ON THE TWO EXTREME SCORES. 
SEVERAL SUCH MEASURES EXIST* WE WILL' LOOK AT THE MOST IMPORTANT 
OF THESE# THE • VARI ANCE * AND THE 'STANDARD DEVIATION'* 



TYPE GO WHEN YOU ARE READY TO GO ON. 

I • • ' 

♦ GO 

OK# HERE WE GO. 






LET'S GENERATE ANOTHER COLUMN OF SCORES AND A COLUMN OF 
DEVIATIONS FROM THE MEAN. 

SCORES DEVIATIONS 



ITEM 


COL. 1 


COL. 2 


1- 


13 


-27*4999 


2- 


75 


34*50 


3- 


1 


-39*4999 


4- 


2A 


-16*4999 


5- 


69 


28*50 


6- 


54 


l'3*50 


7- 


64 


23*50 


8« 


24 


-16*4999 



Coimnents 



Again the student *s computation of the mean value is evaluated by the lesson 
designer's specification in Group 3 of Frame 63 . Frame 64.00 introduces 
the concepts of "range," "variance," and "standard deviation." 

Frames 65,00 and 65.30 then cause a new set of scores and the deviations from 
the mean of those scores to be generated and presented to the student. 

Frame 65.00 fills column 1 of the FLIP matrix with the new scores and 
Frame 65.50 fills column 2 of FLIP with the calculated deviations. 





1 FRAME 66.00 (G) 

I ✓v 

G2. text. 

THE DEFINITION OF THE VARIANCE I SI *THE SUM OF THE Si-.ui-,.. 
DEVIATIONS FROM THE MEAN# DIVIDED BY N*. SO IN ORDER TO COMPUTE 
^ THE VARIANCE OF THE ABOVE SCORES KE SGLARE EACH VALLE IN COLUMN 2# 
i SUM THE SQUARES# AND DIVIDE BY THE NUMBER OF VALUES IN COLUMN 2.\ 
COMPUTE THE VARIANCE OF THE SCORES IN COLUMN 1. (REMEMBER THE 
[ FUNCTIONS YOU LEARNED IN YOUR FIRST LESSON.) 

I G3. ANSWERS. 

1+ SS(2)/N(2) WITHIN .5 
2 SS(1)/N(1) WITHIN .5 

I G4. ACTIONS. 

1 F! VERY# VERY GOOD. 

I 2 RlYOU SQUARED THE WRONG COLUMN# TRY AGAIN. 

-RiNO. *SS(2>* WILL BE HELPFUL* IN THIS PROBLEM. TRY AGAIN. 

I -RsNO. TRY AGAIN. 

-R:NO. TO GET THE CORRECT ANSWER TYPE *.-SSC2) /NC2) * . 



Ir FRAME 67.00 CG) 

G2. TEXT. 

WHAT IS THE STANDARD DEVIATION OF THE SCORES? 

G3. answers. 

1+ S(TRTCSS(2)/N(2)> WITHIN .5 
G/|. ACTIONS. 

1 F: VERY GOOD. YOU RING THE BELL. 

1 F: OK# YOU GOT IT THAT TIME. 

-Rl NO. DID YOU USE THE FUNCTION 'SOFT’? TRY AGAIN. 

-RING. STANDARD DEVIATION = SQUARE ROOT OF VARIANCE. TRY AGAIN. 
-Rl TRY '••SGRT(SS(2>/N(2)> •. I THINK YOU WILL GET IT THIS TIME. 









mmmm 
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Example B— Student (cont’d) 

the definition of the variance I si 'THE COMPUTE 

DEVIATIONS FROM THE MEAN# gouARE EACH VALUE IN COLUMN ?# 

ss r.'r.£s.rs/"» .. c^u- =. 



♦-SSC 1)/NC 1) 
2340.0 



sfc f p 340 

YOU SQUARED THE WRONG COLUMN# TRY AGAIN. 

♦ •-SSC2)/NCs2) 

699*7475 

*1699.7475 

VERY# VERY GOOD. 1 



WHAT IS THE STANDARD DEVIATION OF THE SCORES? 

♦ *-SDC700) 

226799.720 . 

*no!*’did’?6u use the function 'SGRT'? try again. 



**-SGRTC700> 

26.4575 

*t26.4575 

OK# YOU GOT IT THAT TIME. 



Comments 

rpvi*» «+ntlent is then given a definition of variance and is expected to compute 
if usSf f "oL orsqul^d deviations" solution. The anticipated answers are 
speoined in Group 3 Qf 6^.00 as eiipresslons of the constituent functl 

SS(X)/ which makes use of the data in FLIP. 

Our student inadvertently based his variance solution on 

Ms first trv. which \«st3 sensed by the lesson due to the SS(1;/N\1; t , 
f 66.00. His variance solution was correctly accomplished, 

islng the^olumn 2 "deviations" on his next try. In 

deviation, the appropriate SWT function was made explicit to the sbuaont 
his second attempt. 



End of Example B 



4 
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APPENDIX 5 




PROGM: A LESSON IN ON-LINE COMPUTER 

PROGRAMMING WITH THE TINT lANGUAGE 



I 
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I. lOTRODUCTION 

PROGM^ is an instractional lesson viiich has been designed to teach students o 
statistics how to use TINT as a problem-solving aid. 



TINT is a computer progrannning langutage^"^ developed at System Develo^ent 
corporation. It is particularly adaptable to writing^a T 

while the user sits at a computer ty]?ewriter terminal; and then using t e 
™am immediately to obtain the necessary answers. TINT interprets a program 
of ^en^nts given to it to derive the reeulte. The TIHT Intewreter refers 
to the total TINT system whereas a TINT program refers to a collection 01 
statements upon which the TINT interpreter operates. 



Often, computer programs are written over a long period of time ^d 
many times, t would be the case for working out a company payroll. One normally 
expects to de o*be several days or weeks to producing such a program. Hoover, 
one may only 1 Ho use the computer to do some arithmetic. He may ^nt a 
programming If. ;gua,-.e that will let him type his statements as fast and conve- 
niently as pofi 'iblc; Eind then "execute" (i.e., place the computer under the 
control of the orog/m statements) without delay. TINT is ideal for tnis 
application. Tlkre:ore, the TINT interpreter is very useful for statisticians 
and students of sUt ’.sties to use for performing the many tedious aritnraetic 
operations that they frequently encounter. 

PRCXJM was prepared tlu’ough PIANIT, a computer-assisted instructional system that 
provides for the preparation of such lessons on the computer and also 
the administration of the sequence to the student. * The purpose PROGM 

lesson is to teach students of statistics how to write TINT programs that would 
do some of the more common arithmetic tasks. PRCX5M gradually introduces conven- 
tions of the TINT language to the student so that, by the end of the lesson, ne 
will have ceased to interact with the lesson but will, instead, be writing TINT 

programs. 



^he authors of PROGM were: C. K. Frye, P. D. Bennik, and S. L. Fe^igold, all 

members of the Education and Training Staff at System Development Corporation. 

^INT, SDC brochure BRT-5OO/OO5/OO. 

Kennedy, Phyllis R. The TINT user’s guide. SDC document TM-1933/00*V'^3. 

30 July 1965. 

^Feingold, S. L. and Frye, C. H. User’s guide to PIANIT. SDC document 
TM-305 5/000/01. October 17> 19^6. 2l4 pp. 

^The computer programs referred to in this document have been implemented on 
the SDC AN/FSQ-32 time -shared computer, located in Santa Monica, Calif omia. 
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PROGM incorporates several features that allov ^^^“e^ew/rcqies^ 

control over the ex:cuUnr^-^s"in 

explanations and examples , or practice conse^ce^ control words that 

TIOT. These are made available in response to ce^ln hey control to 

the student types. When he finishes with ^y of t^®« portion 

r^srci.T ”SScSf“» S3.. M. .^u'. nv. « 

hours. 



II. objectives 



33S”.3S3 ’ssrs 23S« ”:i233.3r3""33S3S.?^^ 

3™‘3. “*rT.S3r.S.'Tf «U‘t. ..^*,h.» 

access to a system such as the TINT interpreter, and learn how to use it, 

Sred%^enS^^rof°Se stuSnt ' ftl^^TO^f not nereLSliy be Increased. 



The Pearson Product Moment Correlation Coefficient was chosen 

“SfiroSi- =ss s3s:32'3s;33=r.sr.i*s « 

gVS?T2;.SS;."S.3£Sd''; TiTi„ «. ™ u-wr.*.. 

in computations for a wide variety of statistical procedures. 



Satisfactory performance on the above exercise, the teniiinal goal of tMs lesso , 
TO^f alTO insS that the student has learned how to use several Important 
^^^ing techniques, including: (l) how to declare and use item ^es;^ 

(2)®how to make his program communicate with a typewriter tem ^ P^j-ray 
nrocram logical branching; (4) how to program loops , (5) to use ^ 
notation* and (6) how to write statistical formulas in program statement form. 
Even this reLtl4ly small part of the TINT language capability is adequate to 
program very sophisticated kinds of statistical calculations. 



It is not the purpose of this lesson to teach the use or definitions 
statistical measures. It is assumed the student already knows the require 
ones (mean variance, standard deviation and product moment correlation for 
sample data). In those few instances where statistical instruction oes appe r, 
inftSre onipto facilitate recall. There is no systematic presentation of 

statistical instruction. 



III. LESSON DESIGN 



The lesson can be described in terms of the organization and development 
subject matter, as weU as the Instructional strategies and modes of presentati 
employed. These are discussed separately. 
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A. ORGANIZATION 
1. Topics 

The PROGM lesson was subdivided into fifteen topics, each of which contributed 
information and practice that was considered to be essential to the realization 
of the terminal goal. Topics 1 through 3 are preparatory topics. Topics it- 
through 13 are general programming topics, and Topics lU and 15 pertain specifi- 
cally to use of the TINT interpreter.- Figure 1 gives topic titles and provides 
a highly simplified view of the subject-matter flow and relationships among 
topics. 

Discussion of Figure 1: 

. The lesson questions the student and assesses his prior experience with 
the teletype terminal and understanding of the time -sharing system 
commands and the PIANIT student mode. The student may need to see all 
(or parts) of Topics 1-3, he may need only a brief summary, or he may 
enter the TINT programming lesson (Topic 4) directly. 

, After he enters Topic U, subsequent topics continue to build upon terms, 
concepts and relations taught in prior topics. In general, the progress 
is basically linear through Topic 11. 

. The lesson detemines each student's ability with basic arithmetic 

notation and operations. Then students either receive a brief summary 
of those -points necessitated by the teletype-computer communication mode 
eind proceed to Topic 13, or enter Topic 12, which presents rules of 
notation ahd exercises in the use of this notation for evaluating 
arithmetic e:q)refiipion3. 

. In Topic l4, students learn a subset of the TINT interpreter language, 
which becomes their means of communication and control when they 
actually use the TINT program in Topic 15 . They are also made aware of 
TINT command explanations and examples, which they can access on a 
command- specific basis both before and after entering Topic 15. 

. Topic 15 presents a carefully graded series of tutorial programming 

exercises which gradually lead each student into the criterion exercise. 
The student makes use of the TINT program and may interact at any time 
with the Topic l4 TINT command explanations and examples. 

2. Synopsis of Topics * 

This section describes the order of presentation and provides a summary of the 
subject matter for each of the 15 topics in PROGM. 
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1 . 

2 . 



Start lesson 



What preparatory topics 
are needed? 




Brief summary; Topics I -3 

Topic 1--The Teletype 

Topic 2— TSS Exec. Commands 

Topic 3 — PIANIT Commands 

Topic 4--Item Concept' 

Topic 5--Item Construction 

Topic 6 --Item Declarations 

Topic 7— Use of Symbol, '‘=" 

Topic 8 — IF-Stateraents 

Topic 9— C30T0 -Statements 

Topic 10— Loops 

Topic 11 — and/or Connectives 

Criterion test on arithmetic 
operations 

Topic 12— Arithmetic 
Operators 

Topic 13 --Arrays 

Topic 14— TIOT Commands 

Does student want to try 
EXP IAIN, EXAJ^’IE of TINT 
functions now? • 



TINT Command examples and 
explanations 



Exit to the TINT 
interpreter 

Topic 15 — TINT Programming 

Test achievement of 
teiminal objective 

24. End of lesson 



Figure 1 . Lesson Flow Chart. 
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Topic 1 — The Teletype 



Use of the 'RETTURN' key for entering messages. 

Use of the 'RUBOUT ' and quotation mark keys for cancelling and 
correcting messages. ^ 



Use of the ’ORIG' 



and 'CLR' buttons to turn the teletype on and off. 



The student must knov how to turn how“o usf’ 

practicing. 



Topic 2 — Time -Sharing System (TSS) Executive Commands 
Use of 'LOGIN', 'LOAD', and 'GO' commands. 

• 'Progx*am Mode' versus 'System Mode . 

Use of quotation mark and exclamation mark to switch modes 

TSS replies preceded by dollar sign. 

. Use of 'STATUS’ command. 

. Use of 'DIAL' command. 



. Use of 'QUIT' command. 

As in Topic 1, certain conventions of the ’computer time -sharing system 

msf Lo“\o^usrthe Somf aS’^GO 

S^recflves! af h"tiLrinB“ion‘'ate Srand dSl y commands 

for getting help when he needs it. The QUIT conmiand is presented as a 
lor g6oo & y ^ ^ X 4 -vio ‘TQQ ttp glIso xns'bruc'bBd on tho 

means for terminating contact with ^ .. 

iictp> nf the» 1 svmbol to route messages to the TSS and the use oi . • „ 

to redirect menage s back to the loaded program. ’ Most of these conventions 
^iirbe^^cricefas a demonstration of the achievement of the objectives. 

Tn the case of the LOGIN, LOAD, GO and QUIT commands, these are only 
elJplfin^rslnL fny^^ciice w^uld abori-, the operation of the lesson in a 
way that would only confuse the student. 
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Topic 3 ""PIANIT Commands 



Meaning of the asterisk as a PIANIT output (asterisk tells the student 
that PIANIT is "ready” for his reply). 



Usefulness of question mark to get help. 

PIANIT student modes (instruction or calculation). 



Use of left arrow to switch to CALC and up arrow t, to return to 
instruction. 



Use of ♦-QUIT function. 



Use of *-REVIEW function. 



Again, the student must learn certain conventions to obtain the maximum 
benefits from the PIANIT program as it presents the PROGM lesson. These 
conventions are; (l) the use of the ? symbol to elaborate on what the 
student is supposed to do (at any given point in the lesson); (2) the use 
of the *-REVIEW function, to allow the student to selectively browse over 
completed parts of the lesson; and (3) the use of the -QUIT function to 
mark his place in the lesson betveen instructional sessions at the tele- 
type* (The — symbol precedes the function name in actual use to distinguish 
that reply from an attempted answer to a question. Note that QUIT, preceded 
by ♦“ is different from the .'QUIT command, explained in Topic 2 which is used 
to sever connection with the TSS. ) The student practices these conventions 
until he can successfully use each one. 



Since some students might have received all or part of the orientation 
contained in the first three topics from some prior experience, these are 
optional. The necessary conventions are itemized and the student is asked 
if he is already familiar with them. If he is, he can move on to Topic 4. 



Topic 4 — Item Name Concept 



Introduce concepts of program statements, data, storage locations, and 
names for locations. 



Usefulness of statements to manipulate data. 



. Importance of statement ordering. 



^See the discussion of certain special functions that are made available to the 
student in this lesson, beginning on page 167. 
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The goal of Topic 4 is to teach the student to associate item names with 
their corresponding computer storage locations where data are kept. The 
instruction consists of definition and analogy. Interaction with the 
student is restricted solely to concepts. Attainment of this objective is 
assessed in conjunction with Topic ?• 

I 

Topic ^ ■■Constructing Item Names 
. Five rules for composing item names. 

. Single-letter versus multicharacter names. 

. Assigning numerical values to names. 

. Substituting item names for values. 

. Using item names to con^ose algebraic e:q?ressions. 

There are a few mechanical rules that one must follow in composing new item 
names. The goal of ^ this topic is to get the student to memorize these 
rules and apply them both in constructing sample item names and in dis- 
criminating between samples that follow the rules and those that violate 
the rules. 

Topic 6 — Item Declarations 
. Real, integer and Hollerith items. 

. Difference between real and integer items. 

. Distinction between input form and stored form of real and integer 
items . 

In addition to learning to construct item names, the student must learn 
the conventions for appending a modifying word to the name (e.g., REAL, 
INTEGER, HOLLERITH) to form an acceptable item declaration. The modifier 
describes the item characteristics that a TINT program requires for proper 
interpretation of item content. The three modifiers of interest in this 
lesson are: INTEGER, REAL, and HOLLERITH. The first two have their usual 

connotation. HOLLERITH describes an item name that will represent a 
numerically coded collection of letters or symbols. The student is given 
practice exercises that are designed to bring out the characteristics of 
different item declarations. As a test of his comprehension, he is asked 
to deduce how some exemplary item names have been declared from the way the 
numbers that they represent are being interpreted. He is also required to 
compose some item declaration statements and these are checked. 
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Topic 7 — Using the Replacement Symbol (=) 

, Assigning values to item names (e.g.^ MJM = 3 - 0 ) • 

. Successive modification of the value of an item name by incrementing 
or decrementing it (e.g«> NUM * NUM + l)« 



The primary objective in this topic is to teach the student the use of 
"=" in statements which prescribe the content to be stored in a designated 
con?)uter memory location. The item name (previously declared) designates 
the location and must appear to the left of the equal sign. The item 
content is specified by the expression appearing to the right of the equal 
sipn. These expressions on the right may be simple, consisting of .a Single 
integer, or they may be complex "formulae" composed of decimal numbers, 
arithmetic operation symbols and item names whose contents have been pre- 
viously specified. The student is shown a use of the symbol (e.g., 

NUM = NUM + 1 ), for incrementing the contents of a given location. T s 
use of the equal sign results in statements which would be false in 
mathematical contexts. The departure- from mathematical usage is explained. 



Students are asked to construct acceptable statements where the = is used, 
identify incorrectly composed statements, and predict program execution 
outcomes based on sample statements. Remedial help is provided and cri- 
terion questions detemine whether the student should go on. Testing for 
this objective is also Implicitly testing attainment of Topic 4 objectives. 



Topic 8 — Decision (IF) Statements 

, Meeuiing of relational symbols; e.g. , for less than, GR for greater 
than, etc. 

• Differentiating ti^e and false IF-statements. 

. Implications of true and false IF-statements for program execution. 

. Example of use of an IF -statement— "Absolute Value" function. 

. Digression to discuss TINT statements: 

- Usefulness of READ «and PRINT statements 

- Symbol for terminating statements 

- Multiple statements per line of input 
, Optional digression to try out TINT. 
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The task of Topic 8 is to teach the student how to use the computer's 
decision-making capability. He must learn a fairly simple foimjat for 
prescribing conditions which may appear in IF-statements and must leam 
how to trace the program execution sequence which results when tfte condition 
is true and when it is false. Also, the student must leam how to locate 
decision points and prescribe conditions in IF-statements so that his 
program will operate in the desired manner. . 



To test this objective, the^ student is given samples of IF-statements and 
is asked to state the outcome of their use. The number of exercises he 
sees depends on his performance. Then he uses samples of small programs 
in which IF-statements are crucial to their operation. Finally, he is 
asked to write a short program sequence incorporating an IF-statement. 
Remedial information is included in each of the exercises for those who 
answer incorrectly. Poor performance branches the student to review 
material from previous topics. In addition, he has the option of requesting 
a review at any time. . The review capability is e 3 q)lained later. 



Topic 9 — GOTO Statements and Labels 
. Usefulness of GOTO -statements. 



Pairing of GOTO -statements with an IF-statement to achieve a desired 
execution sequence. 



Need for and form of statement labels. 



Rules for composing statement labels; compare with item names, 



. Single declaration for multiple items. 



• Analysis of sample program logic and operations. 



The student is taught to use the GOTO -statements to control the execution 
sequence of his program. The GOTO -statement is not a difficult topic but 
its usefulness is especially apparent when it is used in conjunction with 
an IF-statement. It is 'therefoj^e an objective to teach the student how to 
use the IF- and GOTO -statements in pairs to achieve program branching as a 
function of the truth or falsity of IF-statement conditions. 



A sample TINT program is used to illustrate the role of IF- and GOTO-state- 
ments in the process of summing a column of numbers of arbitrary length. 

The student is asked to identify several specific characteristics that the 
program exhibits (e.g. , the entry point associated with the GOTO -statement 
and the effect on the statements, both before and after the entry point). 
These characteristics are governed by the IF- and GOTO- statements, and he 
demonstrates his understanding of the use of these statements in his answers. 
The student also "tries out" the program, operating it as though TINT was 
interpreting it. 
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Topic 10 — Loops 

• Iteration as a function of GOTO statements and statement labels, 

. AnalyBis of a program loop structure. 

• Statements within and outside the loop. 

. Termination of loop as a function of the IF-statement condition. 

. Importance of j^cluding a variable -valued item in the IF-statement. 

• Danger of non-terminating loops. 



I 
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A program loop is a special case of the IF- and GOTO statements, when they 
are used as a pair to cause a segment of the program to iterate a given 
number of times. The objective is to teach the student how to set. up these 
iterative loops where a set of operations is to be repeated a number of 
times. Using the same illustration as in Topic 9^ the characteristics of 
the loop are brought out through a tutorial sequence. No new information 
is presented for this topic since it is only a special application of one 
already covered. The student is asked to predict how some important condi- 
tions affect the implementation of a loop. For example, he is asked to 
identify initial and terminal conditions of the loop and predict the effect 
of designating the conditions for the loop in such a way that the loop 
variable never arrives at the terminal condition. A wrong answer triggers 
remedial help from feedback associated with Topic 10 frames, or a review ‘of 
Topic 9* 

Topic 11 — and/or Connectives in Compound IF-Statements 
• Review of simple IF-statement. 

IF-statements for comparison of numerical values of expressions. 

. Usefulness of multiple comparisons. 

. Logical operators ‘AND’ and 'OR'. 

. Use of and/or connectives to form coirpound IF-statements. 





, Implications of 'AITD' versus 'OR' on truth or falsity of IF-statement. 

Topic 11 eKtends the concepts of the IF-statement to include compound 
conditions connected by logical AND and OR operators. The objectives and 
the criteria are very similar to those for Topic 8, though related 
specifically to IF-statements that contain these connectives. Again, the 
students are asked to state the outcomes of sample IF-statements and, in 
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addition; are given exercises in identifying various components of the 
compound IF-statement sampies# The students are tutored until they demon- 
strate error-free performance on a sequence of exercises before they are 
allowed to go on. 

Topic 12 — ^Arithmetic Operators 

• Form and meaning of seven operators; e,g«; + for addition; - for subtraction 
(or changing the sign of bh item) ; * for multiplication; **• for exponen- 
tiation; / for division; SORT for square root; ABS for absolute value. 

. Standard arithmetic operations; order of execution. 



. Use of parentheses in algebraic expressions, 

, Optional practice in the use of parentheses. 

The t<ra objectives of Topic 12 are (l) to Identify the keyboard symbols 
that comprise the mathematical notation for programming and '(2) to test the 
student’s ability to use the basic rules of algebra that is assumed to be 
among his entry skills. These rules pertain to the order in which arithmetic 
opei*atlons are performed; both with and without explicitly p3e.ced parentheses. 
Though these are supposed to be entry behaviors; remedial exercises are also 
provided for those who cannot pass the criterion test; since experience has 
shown that these rules have often been forgotten. 

Topic 13 — Arrays ^ 

, Item name defining a block of storage locations. 

, Array size restricted by* the array declaration, 

, Numerical subscript to designate elements in an array. 

. Optional digression to review Topics 4; 5; 

. Subscript bracketing related to teletype keyboard, 

. Comparison of TINT subscript conventions with mathematics subscript 
conventions . 

. Substituting letter subscripts for numerical subscripts. 



Permissible value assignments for letter subscripts. 



Form of array declaiatlon. 
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, Progrcuns that accon^lish the same function with and without arrays. 

- Comparative analysis of program operations 

- Comparative analysis of advantages in use 

- Primary usefulness of arrays 

, Application of array to a con 5 )utational program. 

. Programming exercise incorporating an array, to review and synthesize 
all topics. 

. Programming optimization; coding economy, efficiency of execution. 

In this topic, the student must learn how to declare a number array, how 
to subscript the array, how to keep the subscripts within legal boundaries, 
and how to use the subscripted array in a TINT program. Information from 
each of the previous topics can easily be identified in Topic 13* The 
writing of program loops plays an especially important role in setting up 
the subscripting for the arrays. The sample TINT program (first seen in 
Topic 9 ) is modified to include the use of arrays. 

The student will answer a number of questions about subscripting. Each 
question has remedial material associated with it for those who answer 
incorrectly. 

Then the student compares illustrations of two TBIT programs, one that uses 
arrays and one that does not. He is asked to .identify characteristics that 
depend on the use of the arrays. He also practices with each type of 
program. 

The evaluation of student performance for- this topic consists of two parts. 
First, using the sample program that illustrates arrays, certain alterations 
are made to the program and the student is asked to predict what effect it 
will have on the operation of the program. Second, after he passes the 
first teat, he is presented with a new illustrative program in which some 
key statements have been omitted. He is told how the program is expected 
to function, and must then fill in the missing statements, using ifh&t he 
has learned about aryays and subscripting. 

An alternate track is provided throu^ Topic 13 for those who report 
acquaintance from previous instruction with the array subscripting conven** 
tions often encountered in matrix algebra. 
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Topic 1^ "-TII^T Interpreter Commands 

t " 

. Long form and short form of eleven TINT commands. 

. Distinguishing TINT commands and TINT statements in terms of foim and 
use. 

. Review of program that uses arrays from Topic I 3 and discussion of 
multiple statements-per-line. 

. Contrast use of 'START' and 'CONTINUE' commands. 

. Use of 'PRINT' command and 'PRINT ALL' form. 

♦ 

. Differences between 'PRINT' commands and 'PRINT' statements. 

. Command utility, input forms, and TINT responses presented in the 

context of a program coding exercise, wherein a need is introduced for 
the use of each of the following eleven commands: START, SAVE, lOAD, 

PRINT variations, INSERT variations, CONTINUE, HALT, DELETE variations, 
RENUMBER, EXECUTE, and TRACE. 

I 

. Explanation of 'TINT', 'EXPLAIN' and 'EXAMPLE' student functions; 

optional student tryout of functions before entering Topic 13 • {For an 
explanation of these functions, see the section entitled "Special^ 
Functions" beginning on page I67.) 

* 

The objectives for Topic ih will be satisfied if; (l) the student demon- 
strates a clear, intuitive notion of the utility of eleven TINT commands 
for program coding, editing, execution, saving, and recalling, as well as 
for TINT prograr. control; (2) he can input commands with correct spelling, 
punctuation, and grammatical construction as required by the TIITT program 
input rules; ( 3 ) he knows the exact TINT response variations to expect, as 
a function of how he* uses the eleven TINT commands; and (^) he can 
differentiate between TINT commands and TINT statements. 

Corresponding to each of the four objectives^ the student demonstrates his 
achievement in the following ways: First, problem situations are presented 

that create a hypothetical need for the use of each of the eleven commands. 
The student must choose the appropriate TINT command form to satisfy the 
need and thereby resolve the problem. In some cases, only one command is 
appropriate, while in others, more than one command alternative is possible. 
The students' command choices are tutorially evaluated until the correct 
choice is apparent. 

Second, after choosing a command appropriate to a problem situation, the 
lesson requires the student to input the command from the teletype > Just as 
if he were in direct communication with TINT. The Input is tutorially 
evaluated until he finds the correct input. 
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Third, some problems require that the student obtain a particular response 
from TIIW. The student continues manipiilating the command language until 
the desired outcome is achieved. For each student command input,. the lesson 
simulates the TINT program output. 

Finally, following tutorial instruction, criterion questions test student 
mastery. Remedial instruction is provided, as required. 

Topic 1^ — Writing TINT Programs 

Writing a program that will raise numbers to different powers and sum 
the results. 

Writing a program that will multiply pairs of numbers from two lists 
and sum the products. 

. Criterion test programming exercise: computation of means, variances 

and Pearson Product Moment Correlation Coefficient. 

. . For each of the above exercises: 

- Optional analysis of programming errors detected by TINT 

- Check whether the student's numerical answers are correct or not 
after program execution 

- Help in correcting program logic as implied by answers or as requested 
by student 

- Performance summary for student 

This topic consists of working out assigned exercises using TINT programs 
that the student \frites and executes, operating the TINT interpreter and 
interacting with the PROGM lesson only to have his results and errors (if 
any) analyzed. There will also be help available by request us he does 

the exercises. 

PIANIT has the capability of accessing other computer programs so that it 
can handle the mechanics of making the TINT interpreter conveniently avail- 
able to the student without disturbing his work in the lesson. The lesson 
author simply names the desired program as an object of a branch in the 
lesson and conveys infomiation to and from the program through a resident 
matrix called LINK. This capability is explained in more detail in the 
section entitled, "Tectmical Discussion." 

As the student completes an exercise, he is given the next one. If he 
comes up with a wrong answer, the lesson attempts to analyze the error 
that probably caused it and he repeats the exercise. As the final exercise. 
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the student writes a TINT program that will calculate a Pearson Product 
Moment Correlation coefficient for two columns of data^ where the nuiiiber 
of observations is one of the parameters of the program. 

It is possible that the student may continue to make prograiming errors, 
despite the feedbaclj given to him based on an analysis of his errors. If 
such is the case, remedial. instruction is available to cover general 
problem areas, as well as specific steps toward solution. Entrance into 
the Topic 15 remedial sequences may be by student choice, or by a lesson 
decision based on student performance. The student can also return to 
Topic 14, to retrieve explanations’ and examples of the use of TINT inter- 
preter commands, by using the -EXPIAIN and ^^XAMPIE functions, ^ich are 
discussed later in the section entitled, "Technical Discussion." If the 
student exhausts all available remedial and review material, but is still 
unable to perform the exercises correctly, the lesson will advise that he 
seek outside help. 

What has been presented thus far reflects the sequential development of the 
available lesson subject matter^. It is in5)ortant to note that not all students 
yill necessarily receive all available subject inatter--many decisions of this 
type are made by the lesson— and that order and pacing of the presentation is 
often under student control. 

B. PRESENTATION 

The PROGM lesson authors developed the subject matter using three basic modes 
of presentation; 

. Tutorial 

• Expository 

. Exercise 

Both tutorial and exercise sequences are characterized by a requirement for 
continual student-lesson interaction. The expository mode utilizes interaction 
only as a means for controlling the lesson presentation. In the tutorial 
sequences, authors evidenced the use of both deductive and inductive teciiniques 
in developing subject matter. 

1. Tutorial 

In PROGM, the tutorial approach is used extensively to present new subject 
matter, as well as in special remedial and review sequences. The essence- of 
this mode of presentation is constant interaction between the lesson and each 
student. Characteristics of the interaction are a function of individual 
ability with the subject matter, within constraints of the lesson’s sensitivity 
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to student responses from a teletype. The lesson cont^uaUy 

responses and response patterns to determine If suhjec m er > 

or If the student could benefit from information available but !rnnn. 

other cases, the student is q,uestioned regarding h^ ^®®^51p^v,L^control over 
tinue, and he is given choices by which he can exert considerable control over 

his routing thi*ough the lesson topics. 

The maloritv of tutorial seciuences use a deductive techniaue in developing the 
s^l“t Mtter; tSat is, from information presented by the lesson, the student 
if e^c™I to form certain conclusions. The student's acausition and under- 
standing of information are evidenced in 

the lesson. The lesson uses student responses as indicative of what is neeaea 
tf hff s^dent reach the desired conclusions. To “ 

•Jnflt-nintional sequences provide a more inductive approach to the student s 
fStff Of infoJ^^ion. For example, the student is first ashed ^ sol^ a 
nr^blem. He responds, and, as necessary, new information is intraduced to aid 
the nrmblem-solvlng process. After the student correctly con^letes the exercise, 
the lesson organizes and explains the information the student should have acquire 

from the exercise. 

The tutorial sequences prompt student-lesson dialogue in a number of ways. There 
^ mSlfcSice questl^s, which require choice of a sing^ ans^r to a direct 
Question.^ Another multiple-choice format requires the student to choose which 
statements from a list best meet the conditions specified by a question. Con- 
structed response questions may require a discrete word, number, algebraic 

as a response to a direct question. Other constructed 

response formats ask for various types of completion. For example, in one c 
stSents are asked to complete a sample program by listing those program state- 
ments and algebraic expressions that are missing. Student responses an c p 
SfevSuatef by the TeBson vary from dlecrete verbal and nu^ric^ , 

more stylized or specialized forms of communication; e.g. , algebraic e:preesions, 
St phxasL, special structure • and symbology of TIHT programming code. 

Examples A-1 and A-2 (Section V) iUustrate two tutorial sequences from the PROGM 
lesson. 




2. Expository 

A relatively small segment of the lesson uses a presentation mode that is 
•hAtsinaliv exDositorv. This is true in a portion of Topic l4, where the student 
^^teS wSh thel^esson only to obtain explanations or examples of 
on a command-specific basis. Once obtained, all explanations are ej^ository, and 
aU examples simulate the TINT interpreter. Tutorial dialogue in this case seei^ 
unnecessary. Earlier in Topic Ih, the student is taught of TINT co^nds 

in an Int^ctive tutorial mode. It is assumed that the TINT L 

and exnleuiations will he accessed if the student wants to refresh his memory 
obtiiJ^^greater detail on the use of any TINT command while writing TINT programs 

in Topic 15* 
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Example B (Section V) shows a representative expository sequence from Topic ih 



3. Exercise 

All lesson material introduced in a tutorial mode requires that the stu^nt 
undertake some sort of practice that makes use of the subject matter. This 
practice teOces four general foms: 



. Tutorial drill, to clarify and reinforce a term, concept, or relation- 
ship discussed specifically by the subject matter; ^ 

. Problems that cause the student to make analyses and to synthesize the 
subject matter elements already presented; 

. Exercises in TINT communication; 



• Exercises in TINT programming# 

In the third form of practice, students may be making inputs either to the 
lesson, or directly to the TINT interpreter. For tlie former, the lesson 
exoects a legal TINT input and simulates TINT responses. For all practical 
purposes, the student feels that he is interacting with the TINT interpreter, 
^t has considerable tutorial feedback available as a function of his exercise 
input. Conversely, the exercises in TIWT programming do not provide tutorial 
assistance to the student until each exercise has been completed. 



Examples C-1, C-2 and C-3 (Section V) are examples of the last three forms of 
exercise noted above. They are drawn from lesson topics 13, and 1^. 



C. SPECIAL RJNCTIONS 
1. The REVIEW Function 

The REVIEW function is accessible to the student at all times, beginning with 
Topic 4. To operate the REVIEW function, the- student would type ^VIEW. This 
can be done at any time that the computer is expecting a reply (regardless of 
which reply mi^t be expected). The - symbol prefaces the word REVIEW to 
distinguish that reply as a student request rather than a usual reply. 

Having typed ^-REVIEW, the student is then asked for the number of the topic he 
wishes to review and the lesson resumes at the beginning of that specified 
topic. He is allowed to choose any topic number up to and including the largest 
number that designates a topic he has completed. Even while he is in the course 
of a review, if he wishes to discontinue that review, he can type ^-REVIEW, in 
which case he will be asked if he wishes to review a different topic. If so, 
he will again be asked for the topic number and resume at that topic. If not, 
he will re-enter the lesson sequence near the place where he had originally 
asked for the revievr# The exact re-entry point is deteimined by the REENTRY 
function, described later. ' 
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If he continues in the REVIEW mode through an entire topic, he is asked, at the 
end of that topic, if he wishes to review another topic and, as described above, 
he will either resume at the topic of his choosing or will be placed back into 
the lesson by the REEMIRY function. 

Figure 2 shows the flow chart for the REVIEW function. 

2. The QUIT Function ^ 

The QUIT function is available to the student at all times while he is working 
on the lesson. Just as with the REVIEW function, he can employ this function 
at any time that the computer is expecting him to reply by typing *-QUIT. The 
QUIT function marks the student's place, saves a record of his responses and 
path through the lesson, ' and terminates the lesson. When the student resumes 
the lesson, he follows the same procedures that he used when he originally 
started. However, this time PIANIT will find a record of previous work with 
his identification and will resume the lesson at a point near where he last 
quit, a point deteimined by the REENTRY function. The REENTRY function is 
described later. 

Figure 3 shows the flow chart for the QUIT function. 

3. The EXPIAIN Function 

Following instruction on the TINT command language (TOPIC l4), the student is 
"told" via PROGM that three new options are now available to him: EXPIAIN, 

EXAMPLE and TINT. He is also infoiroed via the lesson that he can try any one 
(or all) of these options before entering Topic 1 ^, or wait until a need arises 
after entering Topic 15 , To activate these functions, the student merely types 
the function name^ preceded by a left arrow (♦“) and followed by a carriage 
return. For example: «-EXPIAIN. 

The purpose of the EXPIAIN function is to allow a student to obtain readily an 
expository explanation of the uses, forms, input rules and TINT responses 
associated with any of eleven TINT interpreter commands. After typing ♦-EXPIAIN, 
the student accesses the explanations on a command- specific basis. He is asked 
\diich command he wants explained and may enter either a number from a list of 
commands, the legal TINT long form, or the legal TINT abbreviation of the command. 
After receiving the explanation, he may either see an example of the use of that 
command, obtain an expleuiation or example of a different TINT command, or return 
directly to the lesson mainstream. Figure 4 is a flow chart for the EXPlAIN 
function. 



^In addition to responses and path this record also contains some of the work 
the student may have done using PIANIT 's CALC mode, e.g., a statement defining 
a mathematical function. 
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1. Entry point from any frame (ty typing 
♦-review).. 



2 . I6 the lesson in the BEVIEU status? 

3. 



Save the previous frame number, oh^ge 
the status to REVIEW and present the 
list of topics. 

Does the student vant to review another 
topic? 

Have the student select the topic to he 
viewed. 



6. Branch to the requested topic 

7. 



Change the status to non-REV^ use 
the REENTRY function to locate the 
re-entry frame number. 



8. Return to the lesson. 



‘xe 2. FlowiChart for the REVIEW Function, 
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1, Entry point from any frame (by typing 
KiUIT). 

S. Entry point for next session. 

3« Is the lesson now in a QUIT status? 

(No if entry is from 1.; yes otherwise. ) 

4. Change status to not-QUIT and use the, 
REEITOY function to locate the re-entry 
frame. 

5. Return to the lesson. 

6. Save the number of the frame encountered 
by the student immediately preceding 1. 
and change 'the status to QUIT. 

8 

7. Use the PIANIT command, FINISHED. 



r 



Note: All seven actions are contained in one PIANIT frame. The FINISHED 
~~ command causes the lesson to terminate and resume at this frame on 

the next session, explaining why 2 is the new entry point. It ®lso 
causes all necessary student records to be saved so that the student 
can pick up 'vdiere he had left off upon returning. 

Since the FINISHED command causes the student to repeat the frame 
from vdiich the FINISHED action was taken, the effect of the manipu- 
lations in boxes 4 and 6 is to ensure that the answer in box 3 vill 
always be "no" when branched to from the lesson, and "yes when the 
frame is re-entered at the start of the new session. 



Figure 3. Flow Chart for the QUIT Function. 
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0£. cU. , Feingold and Frye, p. 70. 
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1. Entry point from any frame 
(by typing *-EXPIAIN)e 

2. Command list presented. 

3 . Student selects a command. 

4. Appropriate explanation is found 
and presented. 

5 . Does student want example of that 
command? 

6. Does student want explanation bf 
euiother command? 

7 . Does student want example of 
another command? 

8. Did student type *^INT? 

% 

9 . Did student type ^-EXPIAIN;, 

10. Activate EXAMPLE function. 

11. Activate TINT function. 

12. Go to Topic 15 . 



Figure 4 . Plow Chart for the EXPLAIN Function. 
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k. The EXAMPLE Function 

This function allows a stuclfint to easily °^>taln one or more 

command as usedj^ the'^^sulCf “output^ , hoth^earing explanatory annota- 

?L\e“im'’tonffo™!'or''to^^^ command. After 

s^ing'the example requested, the student “ "mSt'deLST 

.....nnmna or return to the programming lesson (Topic 15). Or, he ^ 

^“onlnd explanation hy typing -EXPIAIH. Figure 5 is a flow chart for the 

EXAMPLE function. 

f 

5. The TINT Function • 

The TINT function becomes available to the student as soon as he completes 
innic it As with the previously ejqilained functions, he can activate the TINT 
^ttitn'by typing, -TINT at any time (after Topic lA) that toe computor is 

^ s12.it, hi. 

ISrSSS 22 S21LtS1.1.8 TIW. h. W «fK. — “• 

™?rS! Before he resumes the lesson, if he has made one or more p^gram- 

ndng errors while working id TIOT, he will be asked ^an 

analysed. An affirmative reply wiU cause his errors to be ^ 1, 

tten select those that he wants to have explained. Vfhen he has receired as much 
error Information as he ’reauests, hp resumes toe lesson near the point 

off, to^ exact place being determined by the RKENTRY function (see below). 



figure 6 shows the flow chart for the TINT function. 



6. The REENTRY Function 

The REENTRY function is not presented to the student anywhere in the lesson. 

He will prohably not be aware of its existence. 

There are a number of functions that the student “y 

each of which will interrupt the normal sequence of his lesson (e.g., the 
l^ctiLs REVIEW, QUIT., EXAMPIE, EXPIAIN, and TIM). The interruption My last 
less than a minute, several minutes, or several (iays. It would not 
for the student to quit for the day while he is in the °f ® toe 

When he finally finishes his review, several days may nave elaps . ^ 

student resume at the exact point in the lesson where >'® 

cuate The questions being asked are probably closely tied to som context 
^ iliustration or previous dialogue. The R^NTOY function pra for 

toe lesson author to designate re-entry points that constitute punctuation 
marks" in the lesson. When a student is rea^ to resume L ^ 4 

the lesson, the REENTRY function causes him to resj^ at the closest ^ rSatlne 
re-entry point preceding the point in toe lesson where he had on, repeating 

enough of the lesson to pick up the context again. 
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1, Entry point from any frame 
(by typing *-EXAMPIE). 



2. Command list presented. 

3* Student selects a command. 



4. Appropriate example Is found 
and presented. 



Does student vant exasrple of 
another command? 



Did student type ♦^PIAIN? 

7. Did student type ♦-TINT? 

8. Activate EXPLAIN function. 
9 » Activate TINT function. 



10. Go to Topic 15 . 



Figure 5» Flow Chart for the EXAMPLE Function. 
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1. Entry point from any frame 
(by typing *^INT). 

2. Save the previous frame number 
and set up the conditions ffir 
TINT. 

3. Call in TINT. 

k. Return from TINT (by typing, 
?RE/U)Y). 

5. Any errors? 

6. - Does the student vant them 

analyzed? 

7. List the errors. 

8e Have the student select the 

©ri^r he wishes to have explained. 

0 

9. Explain' the indicated error. 

10. E3q)lain any more errors? 

11. Use the REENTRY function to 
locate the re-entry frame. 

12. Return to the lesson. 



Chart for the TINT Function. 
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7, The RECOVER Function 

The RECOVER function is only available to the user who can supply the authorized 

TUe purpoae for this function ^ 

user of PROGM to override the lesson sequence for any given student and fix the 
XLnvf^o^ ^ that, on his next session, the student wlU res^ at a 
designated topic. The need to use this function could arise either from e 
loss of the student's records, idiich are automatically kept, or from a Ju gme 
that the sequence prescribed by the lesson is not appropriate. 

The RECOVER function is also very useful during the checkout of ^ Igsson 
when the student who is making trial runs encounters a snag in the lesson and 
cannot proceed. Using the RECOVER function, the monitor can move him to another 

place in the sequence so he can continue. 

Vfhen an authorised person vants to alter a student's record, he uses tte PMIT 
eommand "OE!!" supplying the lesson name, student identification, and author 
tS^ica^Sn.' e®recelves the n^sUge, "lE^ON SU°°f SPmY ^ED" he 

types *^COVER. He is then asked for the topic number at which the 
Sd «s^ Having given that, the computer replies II^COVEIgD. ^VE MS 
RECORD NOW." This is done by using the PIANH commmd, 3ATO , ^ 

that "GET" had been used. The student resumes exactly as if he had quit at tne 

beginning of the designated topic number. 

IV. TECHNICAL DISCUSSION 

The technical discussion of the PROGM lesson will be most meaningful to those 
who are familiar with the PIANIT system.^j^The reader who desires more information 
is referred to the PIANIT user's manual. 

A. lESSQN STRUCTURE 

The PROGM lesson is broken down into six lesson segments to confom ^ 
maximum space restrictions imposed by PIANIT. The sepnents contain from 50 to 
150 frames each, depending on the average number of characters in the frames of 
ttot seenent. A PIANIT frame is usually equivalent to several typical pwgr^ed 
instructional frames, of the kind found in booklet form, since a single PIANIT 
frame may also contain remedial infoimation for anticipated wrong answers. 

Also, one PIANIT frame mi^t require only a few seconds or over 

answer, depending on the nature of the question posed there. For these reasons. 



%bld . , p. ^ 5 . 

^ ^Ibld . , p. 46, 

^0£. cit., Feingold and Frye. 
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a count of the frames in the lesson is not an adequate indication of its len^ 

either tes?K.raUy or spatiaUy. The estimated t^ ^*“Lnrth M^r^pSioS 
oomnlete his instruction is a useful measure of lesson length. More 
date is needed to establish this, but trials of large segments with undergra^tes 
San Fe^ao VaUey State College indicate that the ™ lesson represents 
from five to fifteen hours of instruction, depending on the studen . 

The six segments are united not only by their subject matter, but ^ ^ 

LINK items that convey information from one segment to vhe next. 

lesson, the LINK items are used to convey lesson progress, ^quests for ^ew, 

to designate entering frame numbers, remedial wrk six 

reports (mainly from the TINT interpreter). Through these LINK items, the six 

segments are integrated into one lesson. 

Tnfnrmatlon is convBved through the LINK items by number codes. TINT communicates 
i?f ^r ?nfor^tI^rthro“uch a code-each error condition that occur^d 
has a designated number associated with it that is transmitted S^ons 

items. Thrcalled segment then interprets the numbers according to t^ 
that they represent. The same is true for other information that is transmitte 

through the IjINK items. 

For the reader who has access to the PROGM lesson through SDC's Q-p time-storing 
lyst^! Z has a printout of the lesson, seesents,!^ Fig^ 7 provides to index 
of those frcune numbers, within a segment, associated vrith eac ess p 

f 

B. FUNCTION STRUCTURE 

The six functions, REVIEW, QUIT, EXAMPIE, EXPIAIN, TI^ and ^OVER, are ^ 
functions in PIAHIT, each of which makes use of the GOTO prtaitive. Essentlany, 
each function (RECOVER excepted), when it is used, causes the present place to 
be marked (by "saving" the current frame number) and the GOTO causes control to 
be^‘ passed to a designated frame where the particular request is processed. The 
request often involves the exchange of segments, though this is handled auto- 
matically so that, at. most, ibhe student may be aware of a brief pause in the 

lesson presentation. 

The REENTRY function is really a combination of a CALC function ^d a 

matrix consisting of a vector of re-entry frame numbers. When the student is 

ftoitok with toe of the above functions (REVIEH, EXAMPIE, etc.) another function 

^^resenting the entire lesson printout would yield a frame -ordered listing of 
all frames, groups and lines of information comprising the lesson. A complete 
lesson printout for the TIOT programming lesson is beyond the inioe^nt and scope 
of this document. Should the reader feel that such a listing is necessary, he 
should contact Harry F. Silberraan, System Development Corporation, Santa Monica, 

California 90^06. 
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LESSON SE 


GMENTS 


Lesson Topics 


A 


B 


C 


D 


E 


F 


1 The Teletype 


3-6.9 




. 






# 


2 TSS Exec. Commands 


7-14 












3 PIANIT Commands 


15-20 




• 






• 


Item Name Concept 




28.1-28.9 










t- Constructing Item 
^ Names 




29-37 










6 Item Declarations 














7 Use of Symbol 




44-63 


• 








8 IF-Statements 




64-81.5 










9 GOTO Statements 




S1.9-93.B 










10 Loops 




93.9-104 










11 and/or Connectives 




105-117 










12 Arithmetic Operators 


25-56 




118-126 




- 




13 Arrays 






127-213 








l4 TINT Commands 








1.8-29 


57-90 




Writing TINT 
^ Programs 












190-346 



Note: 



Tne cells in Figure 7 contain the "begin” and "end" frame numbers for lesson 
topics 1-15> subdivided among the six lesson segments A through F. This shows 
in which segnents and blocks of frames the subject matter is developed for each 
topic; that is, the subject matter outlined in the section entitled "Synopsis 
of Topics." For example, if the reader has a printout of lesson Segment A, he 
could find the subject-matter frames dealing with the "Time-Sharing System" 

(Topic 2) by looking at Frames 7*00 through l4,00. The frame numbering in any 
given se^nent is independent of frame numbering in other segments. The entire 
range of frame numbers within each lesson segment is not reflected by Figure 7; 
there are many frames that do not deal with the topical subject matter, but are 
solely for purposes of setup and control of lesson processes. Also, the reader 
cannot determine the number of frames from this data; e.g., there are 63 frames 
in the block of frames numbered I.80 throu^ 29.00 of Segment D. 

I 

Figure 7» Lesson Structure 
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scans the EEEOTRY matfix, looking for two entries is 

"d rthr?r°a^e^^ng“:S'^:r o/Se^U 

Ltrix. If the original frame number is the sa^ as one of the entries 
EEEWrSY matrix, control is transferred to that freme. 



, . 4 « ,«s-v.-io<(--{rkn n-p the PIANIT connnand. FINISHED. The use of 

S;^"^s“™nt^ Z?eVS ™ved and control is transferred^ 
QUTT ^ 4. j «4- 4a Wli 6 ii ti 6 returns# tie is sent bsek to 

tl^J^^"ent^"1^1nt! T^e ar4 two primary advantages to this ^^rect 
^ irSe FraiSHED^co^nd: - (l) it allows the student ^ be ^e-entered ^ a 
^ei^Lted where the lesson context, can be re-created; and (2) it provides 

a ccmmion frame through which all students teSue 

csoeo^nn -+he frame from which they were previously FINISHED, inis -uecanitiue 

:il^r;;ries:raXr to mser^ sx^dlfications into t^ lesson at a point 

Where he can be sure that all students, will encounter them. 



V. EXAMPIES 



San^le fraa. sequences have been 

the presentation inodes discussed in Part III-B of this paper. 



S.rg ‘ts 

h^thetlcarstuLnt-lesson Interaction based on the lesson content. 
E^laSSry and technical comments are also provided on the right-hand pages, 

beneath the printo’\t. 
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exampie a 



TtITQRIAL MODE 



Example A. 1— Constructed Response Question from Topic 
Exanple A. 2— Constructed Response Question from Topic 
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EXAMPIE A.l— Lesson -Printout 



FRAME 75«00 



(Q> labels UNCOND 



ARE TWO STATEMENTS OUT. OF A PROGRAM... 

^rsu:Tir.GiHrsSMrprj£s;ATEMENT^ 

?rT^NfM^:^^N°t;^5°ArWA^^S^THfsr^TW^STrTlM^r/ the VA.UE OF •RU.-T 



G3- ANSWERS- 
0 KEYWORD ON 
.A+ ABSOLUTE 
A+ POSITIVE 
A+ PLUS 
B NO 

B I KNOW 
B VJILL NOT 
A+ ♦ 

D CHANGED 
D CHANGE 






lev 

I ^ 

ky' 



;;rs’ h^pen 

B riPOSITIVE VALUES OF *MUH* WILL ifUl y ^ 

ns.:r45r^!f!25;. •j^n-sUArswUs. » 

RllS NEGATIVE? . q* CONVERTED TO *^NMH* WHICH IS 

-Flir 'NUH' IS AS%HE 'ABSOLOtE yALilE' FUNC 

FiPOSITIVE* this is COMHO^T^^ 

D ri-hat miu. they he cHweEO, TOT. 

' # 



' i 

FALSE AND 
IF 'NUM* 



»n 

function* 



if 



I 




\ 

f 



,*er|c 

^fy^fflsiasss ' 



cjKtaoiJf!; ■•^zK^atTi - J 
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EXAMPIE a. 1— Student Printout 



HERE ARE T«0 STATEMENTS OUT OF A PROGRAM... 



IF NUH LS 0 
NUH--NUN 
ETC* 



assuming that some ^^iSuf'ulE^HE VAi!ue*^TMAT HA^BEEn” ASSIGNED 

CHANGE THE VALUE OF -NUM-T 



SarPOSITIVE VALUES OF 'HUM* BE CHANGED BT THE STATEMENTS! 



MSITIVE values, of •NUMV.WILL N 0T..8E CHANGED BUT -HAT -ILL HAPPEN 
TO NEGATIVE VALUES? 






Cob— nti 



mili coMtrueted-reipoiiM STiefsoo 

InterMtl-w tutorial ee/^th u»e of ItEWORD in Group 3, 

.wn in coMtnKftlng the entlclpeted eneuer set ran 

!^n«s with BO«inlngful feedbech stetenents In Group 4. 



Tbs student's flret »eponeej^vr^G,^»s stlSent responses 

the -»! feedbeok to SS^n 3 sneSertagerThe key word 

iMt Btadent reBponse. 



End of EXAMPLE A.l 
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FRAME 12.50 



“'s^’^Inything wrong with the program so far? 



G3. ANSWERS. 
POS/NEG 



V 



G5. ACTIONS. nf^Kin LiTTU thf PURRENT INPUT? B5l2*T0 

+F;O.K. ...WHAT’S WRONG WITH THE 

-B:l2.60 



FRAME 12.60 <Q> 



Jr r COMPARE A PORTION OF THE DESIRED PROGRAM WITH WHAT 

VE’V/E INPUT SO FARlK^ 
desired PROGRAM 
♦ 1.00 INTEGER entries# II 
♦2.00 REAL NUM 20# TOTAL! 

,00 TOTALs0l 



♦ 3 



♦ 4 



00 READ ENTRIES! 

♦5.00 1 = 0 ! 

00 XXXX. READ NUM” mtmhte... 
COMPARE THESE FOR A MINUTE... 

GO ...TO CONtiNUE ON. 



♦6 



W 



CURRENT INPUTN 
♦1.00 INTEGER ENTRIES! 

♦ 2.00 N<JM 20# TOTAL! 

♦ 3.00 TOTAL=0! 

♦ 4.00 READ ENTRIES! 

♦$•00 1 = 0 ! 

WHEN^YOU FIND WHAT'S WRONG. TYPE 



• • • 



G3 



0 



. ANSWERS. 
WAIT 60 
keyword ON 
A YES 
B GO 
B NO 



1 



G4 



actions. 

A Rso. K. ••• another miwjte* 

•-RiWNEED MORE TIf®? CYES/NO) 



• -I 



IerIc 






S&E 


















msK 



1 ^ 
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SEE anything wrong WITH THE PROGRAM SO FAR? 



♦ NO 



■r ' 



LET'S COMPARE A PORTION OF THE DESIRED PROGRAM WITH WHAT 
WE’VE INPUT SO FAR: 



DESIRED PROGRAM 

♦ 1.00 INTEGER ENTRIES^ U. 
♦2.00 *REAL NUM 20>, TOTAL I 
♦3*00 TOTAL=0I 

♦ 4.00 READ ENTRIES!. 

♦ 5.00 I=!0! 

♦6.00 XXXX-. READ NUMCIJl 



COMPARE THESE FOR A MINUTE*. • 
... GO ...TO CONTINUE ON. 



♦ , 

N EE b MORE T I t'E ? . < YE S/ N.O > ' 

• 1 I ■ 

♦YES 

O.K. ...ANOTHER MINUTE. 

♦ GO 

O.K. ...WHAT’ 3 WRONG WITH TIjlE 



CURRENT INPUT 

♦1.00 INTEGER entries; 
♦2.00 REAL NUM 20^ TOTAL; 
♦3*00 TOTAL=0I 

♦ 4.00 READ entries; 

♦3 * 00 I =0 > 

♦ 6.00 



WHEN YOJ FIND V^AT’S WRONG# TYPE 



CoBimenti . ' 

An earlier freuiie elmilated e<»e coding Inputs to TIST, whe» the f tost 11^ 
^ntaSed alS^lng Item declwatlon. Frame 12.50 then asks a constructed- 

cSertlSn?^ STstudent didn't catch the error Initially and ^swered 
NO to^^ueatlnn. Bad the anewet been IBS, the student would have immediately 

hwS^tl FraL 12.7^ (nemt page). In this 

SHf <!> WAIT .60 (seconds) In Gro^ 3 f 
■«« +vi® M'feudent's printout after one elapsed period of 60 seconds# Had the 
fl-hudent not tvoed GO during the second one-minute wait Interval*, he would have 
r^Sd^ft“oT^!!.rand been branched automatically to the nemt 

frame. 




k 



mm 
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■ 

FRAME 12»70 <Q> 



l 81 f 
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63* ANSWERS* 
t FORMULAS OFF 
1 KEYWORD OFF 
A+ITEM I 







A+I 

2 KEYWORD ON 
A+ITEM MISSING 
A+I MISSING 
A+ITEM I 
B SIX 
B XXXX 
B .STATEMENT 
C MISSING 
D NOT DECLARED 
D NO DECLARATION 
2 FORMULAS ON 
B 6 MISSING 
B 6 



WHAT 



a‘*F-RIGHt!!^WE forgot to declare item IN THE CURRENT INPUT. 
f’:NOW that YOU'VE FOUND THE ERROR# WE'LL CORRECT IT LATER WHEN 

F:WE EDIT THE PROGRAM. LET'S CONTIj^E NOW*...* .read' 

FsLINE 6.00# CONTAINING THE STATEMENT LABEL (XXXX*) AND THE READ 
P:STATEMEN^^^ hLn'T BEEN INPUT YET* BUT WHAT'S MISSING FROM 
R: WE'VE ALREADY TYPED AND INPUT? TRY AGAIN. 

RiWHAT'S missing FROM THE CURRENT INPUT? 

R! WHAT'S NOT DECLARED IN THE CURRENT INPUT? 

-RiCOMPARE LINE 1*00 OF BOTH SETS OF CODE _ ,,4 

-FlON LI^E 1.00 OF THE CURRENT INPUT# WE FORGOT TO 
FiAN INTEGER ITEM. WE'LL CORRECT IT LATER USING THE 7INSERt 
F: COMMAND. LET'S GO ON NOW*..** 



B 



C 

D 



AS 



I 



t 



# 




I 
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♦ WELL# LINE SIX WASN'T TYPpD x a m twu- • '?f. Ah • 

1 TNF A •(?!(!?# CONTAINING THE STATEMENT LABEL (XXXX®> AND THE REA 

STATC^EN?: SaSN-T BEEN INPUT YET. BUT WHAT ' S MI SSING FROM WHAT 

WE'V/E ALREADY TYPED AND INPUT? TRY. AGAIN# 



♦ON LINE 1# I IS. MISSING 

right* we forgot, to declare ITEM IN THE CURRENT INPUT- 
NOW THAT YOU * VE FOUND THE ERROR* WE’LL CORRECT IT LATER WHEN 
WE EDIT THE PROGRAM. LET'S CONTINUE NOW. •••• ■ 



Comnente 



Frame awaits the student's answer os to the nature 

As can be seen from the student's printout, the frame provides for considerable 
sensitivity to key features of the student's response. Again, this 
plished by the use of KEYWORD and PORMUIAS functions in Group 3, combined with 
relevant tutorial feedback- ia Group 4 of the frame. 



An attempt to match the student's answer with KEYWORD and FORMUIAS 

if the student had typed: LINE 6 00 ISN'T the 

answer would have been matched against the last anticipated ^s^^r in 3 

(b 6 ) because with KEYWORD ON, 6 becomes sufficient for a match to occur and 
with FORMUIAS ON, 6*00 and 6 are equated. On the other hand, had the stu^nt 
replied I SEEM TO BE MISSINO THE POINT or DO YOU MEAN. WHAT'S MISSING?, tMs 
woSld have matched answer tag C (MISSING) and the resultant 
MISSINO FROM THE CURRENT INPUT? wouldn't be very appropriate. This Indlca^s 
that in using KEYWORD with anticipated answer sets, there is some risk the 
prescribed action may not be suited to all student responses in which the 
"keyword" is imbedded. 



End of EXAMPIE A. 2 
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EXAMPIZ B 
EXPOSITORY MODE 



Pxovldlng an esq^lADAtlon and exanqple of 
the TINT TPRIOT connand, from TOPIC 



I 

i 

r 

? 

; 

s 



I 

i 
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FRAME 62.50 CM> LABEL= CUMBAK 

* 

°^*you^were asking about tint commands, want another 



G3. ANSWERS* 

A+ EXPLANATION 
8 + EXAMPLE 
C NO MORE FOR NOW 



2"r.'^F?‘MARlffiR=l FtENTER YOUR COMMAND CHOICE. 



B 

B 



WHCMD 

UHCMD 



I 



# 




1 



I 
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YOU WERE ASKING ABOUT TINT COMMANDS. 



WANT ANOTHER. 



• • • • 



A explanation 
B EXAMPLE 
C NO MORE FOR NOW 

^A 

ENTER YOUR COMMAND CHOICE 






Comments 

A 88 U»e that a studeht had hean loo^ at ^ 

He finally elected to ^‘nee^^oxplaiiation of the traiBT command 

exercises 1“ ^ ^,t frame 62.50 labeled CUMBWC. 

K; to'tKs^l^or^I/pH and ™!RT functions, part III, C .for 
further details.) 

^ a j. «»A’' Yii»vT»ift««.tlon^ as his answer to the multiple -choice 

“.Sr‘*.2“S ^ »...«.».*« «.!.«• 

Note that this framb, ended vlth OT YO® COMHWTO CHOICE. The student’s entry 
Is evaluated by the israme labeled WHCMD (next page). 







f 
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EXM4PLE B— Lesson (cont'd) 

FRAME 65*00 CQ) LABEL® WHCMD 

G3. ANSWERS. 

0 WAIT 20 
146 WITHIN(5> 

A YES 
B NO 
C LIST 

2 KEYWORD ON 
D START 
D ST 

E CONTINUE 
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E 


CO 




F 


EXECUTE 


\ 


F 


EX 


t 


6 


PRINT 


1' 


6 


PR 




H 


INSERT 




H 


IN 




I 


DELETE 




I 


DE 




J 


HALT 




J 


H 




K 


SAVE 


t 


K 


SA 




L 


LOAD 




L 


LO 




M 


TRACE 




M 


TR 




N 


RENUMBER 




N 


RE 




0 


READY 


■ 


G4. ACTIONS 


i 

t 


• 


-FtTYPE A 1 






RtTO SEE 


\ 


A 


RiENTER Y 




I 

D 

E 

F 

G 

H 

1 

J 

K 

L 

M 

N 

0 

B 

C 



CiSET 
CtSET 
CtSET 
C:SET 
C:SET 
CtSET 
CtSET 
CtSET 
CtSET 
CtSET 
CtSET 
CtSET 
CtSET 
FtO.K. # 



NUMBER OR THE COMMAND NAME FROM 
THE LIST OF COMMANDS AGAIN. 

OUR COMMAND CHOICE PLEASE. 
HOLD-RESPONSE 
HOLD-1 
HOLD-2 
HOLD-3 
HOLD- 4 
HOLD-5 
HOLD® 6 
HOLD®? 

HOLD=8 
HOLD-9 
HOLD=10 
HOLO-1 1 
HOLD® 12 
WE*LL 



THE LIST. TYPE... LIST 



FlO.K.5 HERE 



GO BACK 
IT IS... 



TO 



THE PROGRAMMING LESSON NOW. .. STANDBY. 
CtSET HOLD-0 BiLlSTCOM 



Bt 

























j)^ 
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♦type A NUMBER OR THE COMMAND NAME FROM THE LIST* TYPE 
TO SEE THE. LI ST OF COMMANDS AGAIN. 

♦ ?PRINT« 



Comments 

PIANTC waited for the student to specify his cosmand cholc^ In this 

wSoa W8 2i gecbnaa because Group 3 of Pwune 65 .^ (line 1 ) has the 
-inatvuGtlon i uAJT 2^t Coo?P*fin6 the student printout with Group ^ of 
iTs^ttaS 2f!J^20 eecoSS^elapsed the feedheeh n«B8«e preceded by a ( • ) 
symbol was executed by FIMTP as a prompt to the .student. , 

- - . 4^nm^A ?'Pu rtfi^ tile coinpsc^ woird, fom of tiic TIOT! connnftiid. for 

M T -t-a**- rt-f* n TTlfT f each conwand. preceded by a uni<iue 

t« of l!u^ ^^^TS’oroup' 3 of Frame 65 . wort fonts 
end short forms' Of TDOT commands would be matched, as would .numerical entries o 
S^The SsidoT-'e WITHIN(5)’' .antici^tes any student n^rlcal 
entry tom 1 throu^^. The WXIHIM( 5 ) sets up the bouhds for « rea^ of ^tiol- 
pa^ matsricalaniwirt; 6 t 5 -U and. 6 - 5 - 1 . The advantage to the lesson author, 
in terms of economy. of, expression, should be obvious. 

In Qxoup 4 , note that if the response is numerical, a .CAKJ equal 

to the value of RBSPONHE (a PIANTT primitive which always contains the most 
^^ce^ SicL.^Se from the teletype). ■ If instead, ^ 

word font or short form, HOLD will he set to a unljue ^leh 

function of the -Student’s response. Because our student res^n^ TPRIIlT, 
bears a 'O' tag in Group 3 , HOLD was set to h as prescribed by Oro^ h. With 
KEYWORD (W, the fact that the student preceded PHIBT with a t was irrelevant for 

an8war**natehing # 



* 

I 

I 
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EXAMPI£ B— Lesson (cont'd) 

FRAME 66*00 <Q) LABEL® TODIRT 

G4* ACTIONS. 

B:F1NDIT<H0LD# MARKER) 



FRAME 70.00 (Q> LABEL* PRlNTl 

G2* TEXT. 

THE TINT COMMAM) '7PRINT* (OR ?PR) I S U SED TO LIST ONE OR MORE 
LINES OF PROGRAM CODE ON THE TELETYPE* IT MAY ALSO BE USED TO 
LIST THE CONTENTS OF A SPECIFIC ITEM OR ARRAY# OR OF ALL ITEMS 
AND ARRAYS. N 

TO PRINT YOUR ENTIRE PROGRAM# TYPE : W7PRINT ALL\ 

TO PRINT LINE 7*00 FROM YOUR PROGRAM# USE ANY OF THESE! \ 

7PRINT 7\?PRINT 7.0\7PRINT 7.00 ...OR... 

\?PRINT LASTLINE ...IF 7*00 IS THE LAST LINE IN YOUR PROGRAM. \ 

IF YOU WANTED TO PRINT LINES 1 .50 THROUGH 6*00# YOU COULD TYPE!\ 
7PRINT 1.5 6\7PRINT 1*50 6*0 ...ETC* OR, IF LINE 6*00 IS THE LAST = 

LINE OF YOUR PROGRAM;\ 

7PRINT 1.5 ALL\7PRINT 1*50 ALL ...WQiJLD ALSO LIST LINES 1*50 = 

THROUGH 6.00.S 

TO PRINT THE CONTENTS OF ALL ITEMS AND ARRAYS IN YOUR PROGRAM# TYPE: 
\?PRINT RESULTSV 

TO PRINT THE CONTENTS OF A SPECIFIC ITEM OR ARRAY#' SUBSTITUTE THE 
NAME OF THE ITEM OR ARRAY CE.6.# TOTAL# I# NUM) IN PLACE OF THE WORD 
•RESULTS’. TINT WILL NOT PRINT ZERO AND BLANK VALUES* 

G4. ACTIONS. 

B:WUDYU 



FRAME 90.00 <Q> LABEL* WUDYU 

G2. TEXT. \ / 

WOULD YOU LIKE TO SEE AN EXAMPLE OF THAT COMMAND USED WITH 
A SAMPLE PROGRAM 7 ^ 

G3. ANSWERS. 

POS/NEG 

G5. ACTIONS. 

+B:FINDITCH0LD#2> 

-B:NXT 




I"'-. 
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EXAMPIE B- -Student (cont’d) 



the tint command -sprint* (OH ?PH) i;SED TO LIST 
AND ARRAYS* 



TO PRINT YOUR ENTIRE PROGRAM# TYPE: 

?PRINT ALL 

TO PRINT L^^E 7.O0 .FRO^>i YOUR PROGRAM# USE ANY OF THESE: 



7PRINT 7 
7PRINT 7.0 
7PRINT 7*00 



• •'•OR***,' 

7PRINT LA^LINE .#:iF 7.00 IS THE LAST LINE IN YOUR’ PROGRAM." 

IF YOU WANTED TO PRINT LINES 1*50 THROUGH 6.00# YOU COULD TYPt: 



7PRINT :1 .^^6.0; . ..«ETC. OR# IF LINE 6*00 IS THE LAST 

LINE OF YOUR PROGRAM: . 



JpS IIImLU -...would also list lines 1.50 THROUGH 6.00 



TO PRINT THE CONTENTS OF ALL 'ITEMS AND-ARRATS IN YOUR PROGRAM. TYPti 
7PRINT RESULTS 



TO PRINT THE CONTENTS OF A SPECIFIC ITEM OR^ 

"n? °W?L^S^ ^^-iSr jrANo’pLSiK VALUES. 



WOULD YOU LIKE TO SEE AN EXAMPLE OF THAT COMMAND USED WITH 
A SAMPLE PR0GRAM7 



♦YES 



Comments 



affined with U raws and 2 col^. It flUed 

rthTTtrrn^d u n ^s^^r 

ir«rSn. cp~ f 

HOLD VSB set to 4 by Frame 65.0? (prior page;, inus, -one appru^x 
explanation is accessed by PIANIT. 



The student next receives an expository explanation on uses of the TIOT :PRIHT 

^usf^ stuLnt LsweL Group h of Frame 90^ instructs 

PLftNIT to entef matrix FIBDn! again, with arguments of HOLD (previously se 
If Indicating 7ERIin!) and 2 (indicating an example ). 






MHiiiidittlii 
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frame 82.00 CQ) LABELS PRINT2 



I 62. TEXT. ^ 

1 LET'S USE THE '7PRINT' COMMAND ON THE FOLLOWING PROGRAM:\ 

I ?PRINT ALL CYOU WANT TO LIST THE ENTIRE PROGRAM) \ 

♦ 1.00 INTEGER ENTRIES# 1 1\* 2.00 REAL NUM 20# TOTALl 

♦ 3.00 TOTALs0;\* 4.00 READ ENTRIESl\* 5.00 1*01 

; ♦ 6.00 XXXX. READ NUMCI3IN* 7.00 TOTALsTOTAL+NUM Cl 3 1 

♦ 8.00 I = I + U\* 9.00 IF I LS ENTRIESI\* 10*00 GOTO XXXXJ 

S *11.00 PRINT TOTALl\*PRINT C0MPLETE\\*ENTER COMMAND 

7PRINT 2.0 CTO PRINT LINE 2.00) 

\* 2.00 real NUM 20# TOTALl \*PRINT COMP LETE\\*EN TER COMMAND 

?PRINT LASTLINE COR...?PRINT 11 WOULD ALSO PRINT LINE 11.00) 

\* 11.00 PRINT TOTALl\*PRlNT COMPLETE W+ENTER COMMAND 
7PRINT 1 3 _ CTO PRINT LINES 1*00# 2*00 AND 3.00) 

\* 1.00 INTEGER ENTRIES# Il\* 2*00 REAL NUM 20# TOTAL! 

♦ 3.00 totals 0 i\*print completew+enter command 

7PRINT 9.0 ALL CTO PRINT LINES 9.00# 10.00 AND 11*00) 

\* 9.00 IF I LS ENTRIES! 10.00 GOTO XXXXl\* 11*00 PRINT TOTALl 

♦PRINT COMPLETE\\*ENTCR COMMAND 



64. ACTIONS. 
B:ANOTHR 

i 



I 

I 



j; 



i 

f 
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EXAMPIiE B--Student (cont'd) 



LET'iS USE THE 
7PRINT -ALL 



•7PRINT* COMMAND ON THE FOLLOWING PROGRAM: 
(YOU WANT TO LIST THE ENTIRE PROGRAM) 



* 1.00 INTEGER ENTRIES# II 

1 ^ 2.00 REAL NUM 20# TOTAL I 

* 3.00 TOTAL*0I 

* 4*00 READ ENT R IE Si 

* 5*00 1=01 

* 6*00 XXXX. READ MJMCI3I 

* 7.00 TOTAL*TOTAL+NUMtni 

* 8.00 X=Itll 

* 9.00 IF I LS ENTRIESI 

* 10.00 GOTO XXXXI 

* 11.00 print TOTALI 

♦PRINT. COMPLETE 







♦ENTER COMMAND 
7PRINT 2*0 



(TO PRINT LINE 2.00) 



♦ 2^00 REAL NUM 20# TOTAL! 

♦print complete 



♦ENTER COMMAND. 
7PRINT LASTLINE 



(0R...7PRINT 11 



WOULD ALSO PRINT LINE 11.00) 



♦ 11.00 PRINT TOTALI 
♦PRINT COMPLETE 



♦enter COMMAND 
7PRINT 1 3 



(TO print LINES-1.00# 2.00 AND 3.00) 



♦ 1.00 INTEGER ENTRIES# II 

♦ 2.00 REAL NUM 20# TOTALI 

♦ 3.00 TOTAL«0I 
♦PRINT COMPLETE 



♦ENTER COMMAND 
7PRINT 9.0 ALL 



(TO PRINT LINES 9.00# 10*00 AND 11.00) 



♦ 9.00 IF I LS ENTRIESI 

♦ 10.00 GOTO XXXXI 

♦ 11.00 print TOTALI 
♦PRINT COMPLETE 

♦ENTER COMMAND 



Cormoents 

PINDIT brings forth Frame 82.0^, which provides the student 
3lth an expository sUoulatlon of both- TINT .Inputs and outputs. The simulation 
^*^-!^-!^e~T^ested "example" of the use of TINT SPRINT command forms. The 
sSted commaS Inputs are annotated to Indicate what each command form 
accomplishes in the example. 




End of EXAMPIE B 
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BXAMPI£ c 



EXERCISE MODE 

EXAMPIE C.l-AnalyBis and synthesis duestlons from Topic 13 



EXAMPIE C.2— TIllT communication exercises that simulate TINT, 
from Topic l4. 



EXAMPIE C. 3— Exercise in writing a progr^ by direct 
interaction with TINT, from Topic 15- 
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EXAMPI£ C.l— Lesson Printout 



F^An:- 197.-'^0 (Q) 



TFXT. 

t\‘ 0 .-^ vJF. ARF GOING TO MODIFY PROGRAM ** 0 ** $ 0 - THAT IT WILL COM^'JTF 
THF MFAN» VARIANCE ANO STANOARO DF.'/TATION FOR AS MANY AS FJf^^TY SCORFS. 
I ’LL SHOW YOU THF PROGRAM RtJT SOMF S^'^Y STATFMFNTS WILL PF J J-'OOMRl.n'xr , 

•p '‘/ill ALSO SO LINF /inr)FO T^TS T I MF .■^(li YHi!^T I CA^ 

S®fqtpy THF STATfmFNT MQRF FASILY. wvRrr j q T^'F PROGRAM: 



FPAMF 19R.R0 (0> 

TFXT. 

1 ) RFAL NilM » SIJM, SII'ISO^ WAPTAiVOF, STnOF^? 

R), INTFGFR FN'TRTFS. If 
T ) SUM= 

/( ) S'lMiqo- ; 

S ) T — S' 

RF^n FNTRIFS; 

7) LOOPl. RFAD N'JM C 13 J 
R ) S IJ M = S UM + NiJfl C J 3 5 

9) i=J+i; 

10) IF I L5 FNTRIFS; 

11 ) -5 

lO) mfAN=SUM/fnTRIFS; 

IS) - 0 ; 

lA) LOOPP. SUMS -S' IMS 0+ ( ? ) ^*0 

IS) I - I + 1 ; 

KO TF T LS f.mtpIFS.s 
17 ) ; 

IS) \/^R T AN'CF-::S' IMSO/FNTR TF5 * - MvtaNs*!*?; 

1 A) STnOFt;-sq:?T (V^R TANQF ) t 

qq) PRINT MFAN^ 

PI) PRINT VARIANCF; 
op) PRINT STOD^'O; 
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EXAMPIE C.l— Student Printout 



ARE GOING TO MODIFY PROGRAM * *B * ' SO THAT IT WILL COMPUTE 
VARIANCE AND STANDARD DEVIATION FOR AS MANY AS JCOR^. 

BUT SOME KEY STATEMENTS WILL BE INCOMPLETE* 
NUMBERS ADDED THIS TIME SO THAT I CAN 



NOW WE 
THE MEAN^ 

I 'LL SHOW YOU THE PROGRAM 
THERE WILL ALSO BE SOME LINE 



SPECIFY THE STATEMENT MORE EASILY* HERE IS THE PROGRAM* 



1 ) R~AI. S'l, SU-1, RIJMSQ* MEAN, VARIANCE, STOOEVj 

i? ) I-vTi^-GER ENTRIES, I; 



S ) Ir: ; 

READ entries; 

7 ) LOOPl * read NlJ viC 13 . 

R) SIJMr-SHM+.M'JMCI'J; 

9) I=I + tJ 

1'^) IE I LS ENTRIES; 

11 ) ; 

1^) M=*AMaS'JM/'^NTRTES; 

IS) =:S; 

W() L0v)o<2* S'IMS'3 = S'|MSQ+ < ? ) 

IS) i»I-h; 

lA) IF I LS ENTRKS; 

17 ) i 

18) VARIANCE»SUMS0/ENTRIE6 - MEAN++3; 

19) STODEV^SQRT (VARIANCE); 

R<^) PRINT MEAN; 

Rl) PRINT VARIANCE; 

2R ) PRINT STDDEV; 



CoMMinti 



Tha protlsa for the student Is to snslyze the operation of thli sample program 
and to synthesize many concepts and rules learned In prior topics In order to 
correctly fill In the missing entrlss. A serlss of constructcd-responss . 
(luestlons follows. 




* 





























I 
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EXAMPIE C.l— Lesson (cont'd) 



I? ^ , • I ^ 1 y y • *"') (?) 



I 



P-IX MP THP /It,^;';;';''qp ?hp%^NP P0P^ALl''^HR^- 

T!-'.-, 'unHTHAM-i pxp-!”■ssIn^^ omittfo. it sho'ilp bf thf s^n 

•JMi\T IS NiTSSIMG? 



nS. A.\-S/i” • 

1 + 

A n 

o K'='.Y'-jn'?n ni’"’* 
T KN'O-) 
n k'lj-Ycn 
r. f'jn.vi 



( 



tiA . 

C :Kh 
1 
A 

e 

S 



F 

F 

*■< 
n 

F 

r. '•' 

F 

F 

- R 

p, F 

F 



Aor'inNS* . • . -. • ■ ■ 

Y'/O^^n OFF • . .. • ■ . 

aI:. hao bffn 

'("^FScH'oF'^Hr'TH^FrSTATF;.^^^^^^ A ANo’a) ACCIIMULATF. 

?,,f.-.i Ihat val'.if should thfy stabt acci)mijlati.vIo?_ -potainly 

;;F'"sTrPTfro^r,^F^ 

^o: oo.;t_k^. An,«T n. 

?«0H SHOULD flF ASSIRNFO thf vaLUF. O. thf -sum . FTO.. ACCUMULA 

THF^F, 














mmesm 
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EXAMPI£ Cyl— Studeat (cont'd) 



N0>/, LET'S FIX UP THE OMISSIONS. STATEr-^EMTS T, 4 Af.n s AH. 
the RIGHTHANO expression OMITTFO. IT SHOHLO THE SAME FOR ALL 

WHAT IS MISSING? 



♦ ZERO 
N0> THE 
AND -HAD 



ITEM NAME *ZPR0* IS UNOPFINFF). I^ 'ZfRO* HAO “^EFm '^fci aest. 
REEN ASSIGNF'D A VALUE# THPN IT WOULH RF dk. TRY AGAIN. 



* 0 } 

F INE. 



CoMMntg 

H«z« 1ft ftft Intftiftitlng cftftft vhftrft. Group 3 of tlie frftiae 1ft used to dotect tvo 
■Mmlnslr #4ulvia«iit ie.»poMf», 2SB0. mad. ji. But thl. tlM ^ reMon 1b not 
to count ft Tcrbftl ftnftuftr.ft^ulvftlftntjto ft nunerlcftl oii«. Rathiit^ ^ 

dlflterontlfttft thft Ytybftl rftipooftft from the nunerlcal one> go. that fttiproprlftte 
ronedlftl fftedbftck cftn bo provided, aft required* 






wmssmmmim 









I' 
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example C.l— Lesson (cont*d) 



,f7in (0) 

THR5TP ,sTATR-''-?:i\'T? SHO'ILO vAH:^ 

\1> ). SM.V'S'^=0 J\S) ^,Tc;cT^-^ 

\AT L.INF, \\, THF FNIV^F STAT~i'i'^'VT TS rlIS5IK=. 
< 

GA. AN'SWFRS. 

'd KEYWORD ON 
A+ GOTO LOORl 



VHAT SHOULO THAT ? 



A + 


GOTO LOOPl 


8 


GO TO 


C 


LOOP 2 


c 


LOOP? 5 


n 


LOOP 1 


D 


LOOP 1 t 


F 


GOT 0 


F 


T KNO'.aI 



GA. AOTinNS.. ' 

A F *\/FR Y GOOn • ,/.»-»i-m*cr rv^ T T ^'T , ‘JR T TF » ' GOT 0 ' • 

R F: 00 N-T SRPa'^ftT'- THP *GO' «ND -Tn' FO’ TUT. 

• R:TRY again. ciTATtrptTMT -JONl 0 FX^CUTF ONLY ONOF . 

th”'RT.o M,mcn,' -G^.TP.PNT o.cf po, fach 

0 piror^nFO^^'^^P^CF .HFPF ,T-R.n.'T PFLO.G. ••LOOP," IS all OK'p 

RrSTATFMFNT. FOLLO';^ THF. rniF ASK YO'JRSFLF /JHY THF IF- 

^ ^,^clo;A,;S^O.rL^ no IF that STAT^-.F.T 

. /not ICF\'HAf T« S- STATF.F,Nt ' FOLLOWS THF , p -STATF.MF.NT . 

sLa "OOTO" STATFMfnt.' TPYA 0 AIN=P:. 

-F F^ C : • 
















# 
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THOSE THREE STATEMENTS SHOULD READ! 

3) SUM>0l , 

A) SUHSQ»0l 
5 > 1*01 

AT LINE 11# THE ENTIRE STATEMENT IS MISSING. WHAT SHOULD- THAT BE? 
♦1 DON*T KNOW 

THE IF-STATEMENT SHOULD BE YOUR CLUE. ASK YOURSELF WHY THE IF- 
STATEMENT IS THERE AND WHAT THE PROGRAM SHOULD DO IF THAT STATEMENT 

IS TRUE. TRY AGAIN. 

*IS IT GOTO L00P2 ? 

WITH THAT# THE *READ NUMCI3I* STATEMENT WOULD EXECUTE ONLY ONCE. 

THE PROGRAM MUST REACH THE READ NUMC Ul* STATEMENT ONCE FOR EACH 
ENTRY. TRY AGAIN. 

♦GO TO LOOPII 

DON»T SEPARATE THE •GO* AND 'TO* FOR TINT. WRITE# 'GOTO*. 

TRY AGAIN. 

♦ GOTO LOOP If 
VERY GOOD. 



CoimnentB 

Practice continues in the fom of a tutorial conetructed-response exercise. 
Note the usefulness of the KEYWORD function as combined with the anticipated 
answer set in Group 3. The student's first response brings forth a hint from 
Group k of Frame 200, The L00P2 portion of the student's next response was 
cmticipated by the lesson author in Group 3 and^ with KEYWORD ON^ the IS IT 
and ? were ignored. The student's third response was matched on GO TO, but 
is still incorrect. The student finally enters the correct GOTO statement. 



I 



I' 

\ 










ii.l 4J^WJiMU!l!ni^^ 



RipSiSiPPPl!UPllWll|}4|,llSS5!fipiPiP!Pii!!Pii^ 
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FRAMF RPM .(^P) 



which itp:m namr must havc thr valuf, c, 

AGAIN? (CHOOSf^ A L>^TTF:R ) . 



ASSIGN'^0 to it 







GO. ANSWF.RS. 

A. NUM 
R. SUM 
G. SUMSO 
0. MFAN 

E. VARIANCF 

F . STODEV 

G. ENTRIES 
+ H. I , 



G 4 . ACTIONS. 

A R:NO# WE ARE PRESERVING 
R R tUNNECESSARY . 

C R : UNNECESSARY. 

D R:NO. WE WANT 
EE F : UNNECESSARY . 

R:TRY AGAIN. 

G E;NO. WE NEFO 
R:RELO/J. TRY 



THOSE VALU^^S 



AGAIN. 

TRY AGAIN. 

LI NR A, TRY AGAIN. 

try again. 



TRY 

•SUM* IS NOT USED ANYMORE, 

IT MUST STILL RE ZERO FROM 
TO SAVE THE VALUE IN, 'MEAN* 

THAT item gets A VALUE ASSIGWEO RELOW LINE 

TO PRESERVE 
AGAIN. ■ 



1 7 



THt^ VALUE IN 'ENTRI'^S* FOR THE STAT'^M^mts 



H F ; 



FRAME G0O.O0 (9) 

i 

GR. TEXT. 

WHAT SHOULD APPEAR IN PLACE OF THE < ? 

GO. ANSWERS. 

A + NUMC I 3 
R NUM 

1 keyword ON . 

C I KNOW 
D A 
D R 
D C 



) I N L I iVE 14? 






G 4 . actions.' 
C:K'^YWORO OEF 



F : 

R:Y'^S> RUT IT MUST 9 E SUBSCRIPTED 
F:THIS IS TO BE THE SUM OF 
R .^jFPRESENTS the SQUARING. 

F:NO> THAT STATEMENT SUMS 
F:THE SYMBOL FOR SQUARING. 

R tSQUARED? 

R:N0 j try once MORE. 



( I 



. NUMC? 3 ). TRY AGAIN. 

jH(T ^qiiAREO DATA '^NTRI'^S. THE 
WHAT IT^^M NAv.tr ;;?trpi:?FS'^NTS THt^ DATA? 
THE SQUARE QE EACH haTA ENTRY. THt^ 
WHAT ITEM NAME HOLOS TH" DATA TO RE 



-C C: 

D R:TYPE THE ANSWER, 



NOT THE LETTER CHOICE. 



IS 
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AT LIN’c: 13^ >JHJCH ITRM (vAM'v ■MIJST HAV'v THR* VAL'IF> a3SI'3iV~o jn TT 

AGAIN? (CHOOST A LFlTTfCR). 



A . NUM 

B. SUM 

C. SUMSQ 

D. MEAN 

E. VARIANCE 
F> STDDEV 

G. ENTRIES 

H. I 



UNNECESSARY. 'SUM* IS NOT USED ANYMORE.. TRY AGAIN. 



*I 



CHOOSE ONE OF THE ABOVE LETTERS. 
FINE. . 



/JHAT SHOULD APPEAR IN- PLACE OF THE (. ?. ) IN LIN^^ 1 A? 

-l=:\'UM 

YESj BUT IT MUST BE SUBSCRIPTED (I.E. NUMC?] ). TRY AGAIN. 

♦ NUMC n 
TRUE. 



Coniaentg 

Of inteyeet In these f^^.s Is, the euthor*s atteapt to; antlcipa^ student 
responses and .provide usef^ feedback*. For exainple^ in Frame 202.00 the 
author has even anticipated that the student nay try to enter a multiple- 
choice tag fxw.the prloir frame > rather than entering a constructed response 
(Group 3— D k, D B|,P C); Our saaiple student didn't try thlS/ but did 
receive feedback appropriate to his answers* 










sasmaam 



A 







UUStiSiBE 
















t 

[ 
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t 

r 




f 



I 



I 

r 




EXAMPIE C.l— Lesson (cont'd) 



FR^\M'5’. ?C^T.f151 (CJ) 



G2. TFXT. 

vJHAT STATP'M'^NT RRLONfiS IN LINR 17? 



•ST. aNSWB'RS. 

2 kc-y/^oro on 

A+ GOTO LOO®? 

A+ onin LOOP5>i 

R RO TO 
C LOOP1 
0 LOOP!'* 

0 i.nnp ■? 

D LOOP P i 
R G OT 0 
P 1 KNOW 



WRITR. 'ROTO'. 



R4. ARTlOivS. 

A R:ORRY GOOD. 

R RtOON'T SPPARATR THR *RO' ANO 'TO* ROR TINT. 

r P *THAT^'jILL*-' 1AKP THP PROGRAM GO PARK INTO TRR R 7.RST LOOP AGAIN WHIRR* 
piiryo'j WILL ROLLOW TMR LORIO, ./ILL S^T -P ^ NON-TppmINATING LOOP, 
p I Jpr nnM*T WANT THAT* THY AGAI^'* 

0 F:YOn INCLHO^O A SPAC^r IT 0!0N*T *=<JJ'LONn. ••LOnPO** IS ALL Op • 

B- ?r«^ROTO'^'^IR^'?l-?RT P’lT I OTONR'T RpOORN'IZp TW' RT-aivOPR 0^ THR 
R • GTATRMITnt, “ OLl OW TRp ''ROTn'’ ''TTR TWir CORRRCT LARPL. 
p r;?Ir ^MOllLri =|- V-HR n.-t-. «sv vn.l=!<;>-Lr -.'MY 

IS «0 IMOT TM. n-> ,r TU.T ST<.T:^M.CT 

TPn^* TPY a»;a|n* _ 

- F;\0. NOTIOP TPiiT T^IS GTATP--Pf'T POLLO IS T'O' 1 R-GTATP'^pNi • 

R:TRY fiRAIM. 

-F FsTHIS WILL A ••GOTO'* STAT^M^nT. TRY A?Alv=Rj. 

- R‘ F ; C J 



RRA;'P <0) 



GP. TRXT 
NOW I 



•HLL PRINT TPP COMPL^Tp PRO-PSvi POR YR'.':* 






I 



i 



I 

[ 

j 




pqAMP P'IS.AA C9) 



RP. 

1 ) 

P ) 

S ) 

A ) 

S ) 
f , ) 

7 ) 

R ) 

9 ) 

1 0 ) 
1 1 ) 
I P.) 
1 S) 
1 4) 

1 S) 
I X ) 
1 7) 
1 R) 
1 y) 

PS ) 
p I ) 
00 ) 



T K XT • 

RRALN'i'N • SUM* SU''50* MRAN* VORIANRp, 
InTRGFR FNTRI^S* I» 

S'JM-S I 
SUMSO-SI 
1 nS I 

RRAD PNTRIR5J 
LOOPl. RR.AO NUMCI3I 
SIJM-SUM^NUMC 1 3 I 
l-I'Fi; 

IF I LS RNTRIRISJ 
GOTO LOOPl J 
NRAN-SU'l/RNTRIRSl 
1=0 f 

LOOP? . SUMSO-Slli-iSO + NUMC I 3 ♦♦PI 
I = I + U 

IR I LS PNTRIP3J 
ROTO LOOP? I 

yARIANCF = S'JMSO/RNTRlRS - MRAN^^pj 

fiT0'V-:y = S''V1T (UAR 1 ANCR ) I 

PRINT MRANJ 

PRINT VARIANORl 

PRINT STOORV/J 



STOOPVI 






aatiilMMiailBiaMiaBiaiaiBBMriaamitgiaeiMaBMiiaiaafaiaa^^ 









f 



r 
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‘J MAT 


STATT.^TNT 5FM-0r‘GS 1 


+-GOTO 


L00P2 


V T.PY 


GOOn. 


N'nw I WILL PPINT TH^ 


1 ) 


RTAL i\‘U'^ ' 


2 ) 


I NT F G F NT '^A F S > I 


3 ) 


in 

II 


4 ) 


S' IMG 0=0.: 


5 ) 


I =0 J 


A ) 


RF.AO FNTPIFS; 


7 ) 


LOOPl • RFAO NUL/C13 


G ) 


c^t jMss.Sijjvi + N'.lMC 13 5 


9 ) 


1=1+15 


1 3) 


IF I L3 FivT2IF5 5 


1 1 ) 


GOTO L00°15- . 


12) 


T N = S LI M / F N T 2 I F S 5 



I 4 ) LO OP 2 • SM S 0 - S ’ S 0 + M >''■ C 13 -^2 

15 ) 1 = 1 + 15 

lA) IF I L5 FMPIFS5 

17) GOTH Lonpp; 

IS) \/,^s 2 ,TA^iC^=S'^MS;»/='^'TPlFS .- 

1 9) $tnOF'^=5-'^^')’^T (V Ap TA.vOF ) .« 

O'/l) PPTN'T 

:> 1 ) P .21 1'^T A ‘M A (3 ; 

po) >=2 TNT ATHOh'/; 

CQTnm^nte 

The Btudent ooapletee the exercise on “>^3^19 synthesis of concepts and 
receives s sunsnary. of what bo has accomplishede 

Ezxd of EXAMPlB'Osl 




"3Ci^jCiCt>^et2JP t • * 









*‘*'*«a5B52BB9l! 
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EJCAMPIE C.2— Lessbn Printout 



FRAME 16.25 (S) 



G2< 



TEXT. 

NOW YOU TRY TO COND^JCT THE SEARCH 
PROGRAM. USE EITHER THE ’7PRINT X Y* 
THE '7PRINT* COMMAND. 



THROUGH 
OR THE 



THE 5 LINES OF YOUR 
•7PRINT X' FORMS OF 



FRAME <Q) 



G2. TEXT. 

\ CENTER C0MMANn\>f7 = 



G1 


1. ANSWFRS 


A+PRINT 


1 


5 


R+PRINT 


1 


A 


C+PRINT 


1 




D+PRTNT 


1 


C> 


E+PRINT 


1 




F 


PRINT 




S 


G 


PRINT 


o 


4 


H 


PRINT 


c> 


3 


I 


PRINT 


c> 




J 


PRINT 


3 


5 


K 


PRINT 


3 


4 


L 


PRINT 


3 




M 


PR- 1 NT 


A 


5 


N 


PRINT 


A 




0 


PRINT 


5' 




P 


PRINT 


X 


Y 



0 

R 



PRINT ,X 
PR 

KEYWORD 



ON 



G A . 
A P 



D 

E 

F 



G 



ACTIONS* • ■ # ♦ • > ' - . . 

N + l'.-JJ??) iNTEG'ER 'ENTRlPSlV+R.'^O REAL N'l^' R'?’. TnTAlJV*'^ .'5''^ rOTAL-’l'; 
E:*i5.(3if!) eE'AD ENTR'IESj\*5.'’’'? I ^ N*PRI.f^T nO'''*PLETP 
Ej'f'I.PJO INTERPR EMTRTPSI RPALNU'^’ 2{^> TOTAL; N + A TOTAL*Rl 

Ft*4,m RPAp ENTf?lES)V>fPRINJ COMPLPTE 

FJt'l.'^'A INTEOPR E^NTRIES I Vt'R .0'^ REAL N'JM TOTAL; \*'l .00 T0TAL=0| 

F:*PRINT COMPLETP ^ c-..- 

F|ifl.00 INTEGER ENTR lES I V’t'R .'=50 REAL N!JM RO, TOTAL; V’t'PR INT COMPLPT-. 

INTEGER ENTRIES; S^PRINT COi’iPLETP 

'real NUM 20* TOTAL; V*A. 00 T0TAL"0 ; .'’>'51 RpAD ENTRIPS; 
I=0;\ SPRINT COMPLETE ^ 

REAL NUM 20* TOTAL; . '510 T0TAL=0 ; V* A .00 READ ENTRTPSf 

COMPLETE 



F t ♦! .00 
F : *2 .00 
F :*5.00 
F * *2.00 
F j *PRINT 



H 

I 

J 

K 

L 

M 

N 



FIX'S. 00 
F J*2*.00 
F »*.3,00 
F iXcT.OO 
F 1*0 .00 
F : #0^ 

F X 9^^ 
F 



REAL'MJM 20* TOTAL; VX'0. 00 TOTAL»0 j\X«PR INT COMPLETE 
REAL NUM 20* TOTAL; \*PR J NT OOMPLpTP 

TOTAL"0; \*4.^0 READ ENTR I E5 ; V*S .00 I’»0;\4PRINT COMPLETE 
T0TAL«0; \*4.00 READ PNTR lES I Vx<PR INT COMPLETE 
T0TAL«0; SX-PRINT COMPLETE 

READ ENTRIES; V*S. 00 lnO;V*PRTNT COMPLETE 
READ ENTRIES; VXiPRINT COMPLETE 
lsO;\*PRINT COMPLETE 



PO FiTHAT'S A GENERAL FORM OF THE COMMAND. R'lT SI/RSTITUTE LINE 
FjNHMREf^S FROM 1 through S TO SELECTIVELY PRINT LINES PROM 
R I YOUR C'IRRENT PROGRAM. S*? s 

-FlI DON'T RECOGNIZE THAT AS A PRINT COMMAND OF THE rQRM '7PRTNT X' 
FiOR '7PRINT XY'. TYPEiVS • PR I NT < SPACE ) X ( S° ACE ) Y' SV ORV 

Ft 'PRINTCSPACEIX'WEOR examplejv 

F; 7PRINT I'G (PRINY LINES 1 TH^niJGW G)\ 7PRINT G (PRINT r- 
RlLlNE 0 ONLYJVVNOW TRY AGAlN.V*? » 

R FjYES* *?PR* is a legal tint command FOP.M* A'JT PLEASE USE '?pRTnT' 

R:FOR THIS EXERCISE. S*7 n 



mmmmi 




I 






I 



! 



#1 1 



li ^ 
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vn-; Y0n,T7Y T^ 
p n’-^R A .•* . ’V, ^ J. T i- R T 

y 1_!T • R T «VT ' C O'-l'^'^ • 



t- '.n} T K R go ■) M N 0 
^ -p p -:^ I ,'.iT X Y 



nMOMCT TW.- t 



|- I 0-.3 -5 T . T 



Y« p? T'm; 



00 7 T ‘-'T 



s.» t 



.•• ,T Vf'.'I’' 
■ r. .•' .' r ~ 



^ - - xi - i -• - » ^ .. •• •, q'lT ^.: 1-5 :tT T T iT^ 1. Ti' “ 

X MAT'S A G-^N^^RAL 1; xn'* L - T ^ PllrT >.T'— S P'P'' •■ 
iVHGH-RS PRO.'i \ THROUGH 7 TO -.l 

YOUR CURRENT PROGRA^^. 

*? PR IfvT 3 S 
H'.O.OO T0TAL=(^5 
4- .^.00 RTAO J^NTR 1 T-5-^ 

>}:S ,'^0 T=0 ; ■ • 

sJ^PRINT COU^LPTR • « ■ ’ ’ , 

f* 

CoBineirtg 

The etuaent Ibegto* ^ i^r*to*ftoa ^tolch line Is In 

combination of the v of two general forms of 

error “ the stuaeit-e. Input of FEIOT 3 5* the 

the TUn tWOTr °°"5S?’ . 3*^ through 5.00. »<>*« 

lesson slaulniee-a input with a. 7, even ^u^ it 

student did not I*?* >2?JS JIm* li C^ 2 of Frsme l6.30 caused t^ 

would be required, by Ik exerSses, «ie lesson v^tB printing 

1 symbol to be prin’ted. remilArlY" as part of bis command 

the 7 K»d the tS^®^r hand^ the student had 

Si t' it -uld have been accepted as correct 

because KBYWOW) iii turned ON In Group, 3. 








ikiiiMiiiiiii 















30 Octol)er 1967 

EXAMPIZ C.2— Leewn.(co*i^*^) 



210 



TM-2914/IOO/OO 



1 n • (H) 



YOM .lYo TH-: LI..- vn. lookik.. 

^;.SP ^-VFINO tmI? uirvK Ynn i.nnKi-'i 



FRAMF lA./iS <9> 



GA. A^’S^I’^R‘5. 
P OS/N^-9 



Q5. ACTIONS. PRI,vTnUT YO^l 'AT CS I';-''. ? 

+ P-;0H? ... A:IS LlNi. 1. I' Yf,,, . OA - 

-FiTHAT'S SIGHT. SO ; - U- AT 

F:LI^!R 1 AGAIN, 'i.^IKG TH- • ;• ,. ..^ .^nvj at *' Y- > 

+ -:HFY,. ASF YOU TSYJNG TO !, tY-- ^ 1 jY- 1 .AA PSI'TOor. 

F:TSY THF '??.SINT' COTNANO ARAL. Ti 1 .1 . - . - 

r,-i qar'K NnJ A^^, l^-T YOU .SFA'ICH FOS 
-F:THAT'S so . a L. on-..', act. A; 1 A.A-> 

AGAI ■''‘> MSIl'G iH . .. .u-i 









■A . 

1 •<-T 



/as-c. ./rro< 5 , 

Y •' n ^ n OP P 



i 



'1 

o 



Y5T 

. r 

VT 



y.ion'^ ry 



G 1 - 1 
n-M . 



r. •!• 1 



■* 

/'I 



G • 

A 
0 



1 * 
« • 



"J'-.o'.C'i” -hat 'IAS THP Lliv: •■.tvaaST' 

.■l,r,ST....LFT'S i-IX I.IN”-. ' '■■ 



- •'«* 



.AMI., A,:n- "-i , -in-.v.A, A Y-l !I.S'-.'), A 

sRIAF you OIO. "'I It '....ftT vn.l htcsI'/'-o. NOT-'- THAT 

iNAS,*FKTSr-:.S- ' t’-. LL- SY.OMLO 7 

!it.ci.,M.A';- rrc-'. •!• in 1^1; .; Y: ,'‘.\v'.h‘ yam .i„'.its,ata,vo? . 

. !« 1 'VI T:^:TPG" -i P'Vl -J I " , J.’NN"' ' 

u ' I • ' * 



vn CiT 



r-T 



•A"' : \ 



i: 



o 

ERJC 









mi 



mammm 









SSraCBPIWS!n«P!PS53S8R5S!!!!TO^25!»®J!S55S3^^ « 
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H* T'VO T'^^r LI->'^ YO'* VjFTR^ LOO'<I"^ 1 .-’ 

^Y'*S . , , ... . 

iV-^n T^' R='^'T^'T^MT Y'-V! ’-■> T'R'riv/Th? 



iiJYr' 



T M A T * -S R 1 "s HT > -^0 ''•’ * L L n P. H P .« '■> "'' 

L T ••‘‘v \ A R A T > ’ !S T ^R T • ? ::> ^ t '. T P P • 



■) T7 T Y »■ '' • • A A ■? n ^ CO"? 



* i\'T R C (.'•■'} ’^/A f'*0 ■■ 

A? pRirT I <"' 

.-’JJM XMT”R".R lEi'^’TKlPIS; 

REAL N'UM 2'^^ tOTAL? 
T0TAL“^<^ 

»}: /I . '•! ^-1 ‘ R «: A D e: i'' T RIPS ; 

>J-oR [NT OO-r-^LPT^! ■ • 

n 10 YOU PINO THP LTNP VO'I *JPPP 



1 r.OK T 



!' POP? 



’JiYPS 

R c*nn . . . >;hat -.vas ' t'-^t li pp *’ ' ' ’’*■ ’ ? 



^ 1 • ^ 
p I R «4T • . . LPT ' S T I K L T ' " ‘ 1 
p o v,...A NO . 



0-'?i 



re/, MSTi-.R THP '7TKAPPT’ 






Comaente 

A decision (d) fipsttje next detemiaes vhether the student should see 

Frame I6.U5 or Premc 16.50^ depending on his answer to Prasne 16.30 (prior 
page). In this oase, the. student did not request a printout that contained 
line 1.00 (lihe line in error )> so he sees Frame l6.45 as prescribed by the 
decision frame. Frame then clarifies what line the student is looltlng 

?Sr 2nS bmvches him hack tb. Frame 16.30 (prior page) to try the 
connmnd again. .This tine the student is successful with a command of tPRINT 
1 4. The lesson slmuiates the appropriate TIIJT printout and the student 
indicates that he is now aware of *the line that is in error. 



End of EXAMPIE C.2 
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TU-S9lh/lCO/00 













FRAME 310*00 ^y> 

G^ • TEXT# ^Ljc* c* I liJi r\isr twp *PATR PRODUCTS* OF TWO 

SUPPOSE YOU WANTED ^0 FIND THE SUM ENTRY IN THE FIRST 



FRAME 31 1 .00 

oo‘you’'think you could write such a program now? 

G3. ANSWERS. 

POS/NEG 

G5. ACTIONS. 

+ F;OK# LET'S TRY. B:TWOGRPS 



FRAME 323.00 <0> LABEL* TWOGRPS 



WRiT^A^TINT PROGRAM THAT WILL FIND THE SUM OF THE 

FOLLOWING TWO LISTS OF NUMBERS. (SAVE THE PROGRAM YOU WRITE. Y 

WILL BE ABLE TO USE IT IN THE NEXT EXERCISE.) 



I 



I 







H.:u* X»--- t^JUL., 



{ 

« 



mmssm 







0M-291^/lOO/OO 
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KXAMPUS .C» 3— Student Printout 
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SUPPOSE YOU WANTED 
LISTS OF NUMBERS <I*E 
LIST BY ITS CORRESPONDING 
PRODUCTS) • THE TWO LISTS 



•PAIR PRODUCTS' OF TWO 
ENTRY IN THF, FIRST 



TO FIND THE SUM OF THE 
YOU WANT TO MULTIPLY EACH 

THE SECOND LIST AND SUM THE 
SAME NUMBER OF ENTRIES 



ENTRY IN 
WILL HAVE THE 



DO YOU 



THINK YOU COULD WRITE SUCH A PROGRAM NOW? 



*YES , 

OK# LET'S: TRY. 

* 

I 

WRITE A TINT PROGRAM THAT WILL FIND THE SUM OF THE 
FOLLOWING TWO LISTS OK NUMBE0?S. C SAVE THE PROGRAM 
WILL BE ABLE TO USE IT IN THE- NEXT EXERCISE.) 



PAIR PRODUCTS OF 
YOU WRITE. YOU 



THE 



Gomnents 

The etuaent 1. now to ^ 

that he la wady, toat^UoM iw «ried bv the leaeon for each try 

ar^^eK^li “tt^t hai«tfweT.d HO to' the question', he ^uld have 

le^nce. Z prtpate hdm for the progr«»lh« exercise. 
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L/ EXAMPLE C.3— Leeson (coat'd) 

FRAME 324*00 (P> 

G6 . STRUCT. /STUD. PREF . 
M N 

G7. DIST. 

'^N 

G8. Ml R1 SI MS R2 C N. 
50 100 N 0 100 R 13 



FRAME 325.00 (P> 

G9. HEADER. 

PAIR NO. LIST 1. LIST 2. 

X X X 






FRAME 326.00 (0) 

G2. CRITERIA. . ^ 

CiSET LSTFRM»327 FtWI'LL LOAD TINT FOR YOU NOW...»B:220 



FRAME 220.00 CD) 

G2. CRITERIA. 

FiSTANDBY. CjLI NKC 1 )»ARRAYC99000#0#0#0#0#0#0#0#0>0) BtPINT 









I*. 
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EXAWPIE;c.3-«^.tudent (cont'd) 



AIR NO. 


LIST 1 . 


LIST S. 


1 - 


3S 


6S 


S“ 


69 


49 


\ 

.■ \ 


64 


3 5 


4- '■ 


55 




5- 


39 


44 


6- 




38 


7-.-' 


46 


46 


' 8- 


• ■ 58 


39 


9- 


SI 


V> 


10- . > 


SI 


6 5 


I’LL. LOAD 


It 

TINT FOR YOU 


NOW. . . STANDBY 



Ti.:-29i^/ioo/oo 



CENTER COMMAND 
?START 

m 1.0(5 INTEGER ENTRIES* I> 
i » 2.00 REAL LISTl 50* LISTS 50* SUMPPJ 

» 3.00 READ ENTRIES! 

[ ■ » . 4.00 I *01 

» 5.00 LOOPl. READ LISTlCIIl 

< f » 6.00 1*1 + 11 

i. m 7.00 IF I LS ENTRIES!: 

^ m B.00 GOTO .LOOPi t 

* 9.00 1*0! 

i ♦ 10.00' LOOPS. READ LISTSC I]! 

♦ 1 1 .00 1 * 1 + 1 ! 

» IS. 00 IF I LS ENTRIES! 

» 13*00 GOTO LOOPS! 

I » 14.(50 SUMPP*0!.. 

15.00 1*0! 

* 16.00 L00P3. SUMPP*SUMRP+LIST1 C n*LIST2C I ]! 

» 17.00 1*1+1! 

m. 18.00' IF I LS ENTRIES! 

* 19.00 GOTO L00P3! 

* S0.00 FORMAT FRMT* C 'SUM OF PAIR PRODUCTS * '* F14.4! 
SI. 00 PRINT FRMT* SUMPP! 

I * S2.00 7EXECUTE 



I ComiaeptB 

I — ^—i— 

I Frame 32lf eeta up the . drawing of pseudorandotn numbers from a bivariate normal 

I distribution and Frame 325 sets up the. presentation format. The list of numbers 

for the exercise is presented and PIANIT .obtains the. TINT interpreter (PINT 
I version) via control Jrame. 220. TINT then initiates the programming task by 

I printing CENTER COMMAND and the student inputs a perfect twenty-one line program, 

I followed by an- ?EXECOTE command on line 22.00. Had TINT discovered any errors 

I in the student's inputs, they would have been flagged and the student would have 

I corrected them prior to . execution. 













mmm 
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i 



a!M-291^/l00/00 



FRAME 327.00 (Q) 



G2. TEXT. 

WHAT ANSWER DID YOU GET? 



G4. ACTIONS. . , . 

CzFUNCTION SS(X#Y) = SUM PROD VALUES(I*X) F0R(J=1#Y I = NN(1>) 
CzFUNCTION PP=SUM VALUESC I > 1 > VALUES! I ^ 2 ) FOR ( I = 1 # N ( I ) ) 

CsFUNCTION CORR=SUM ^ 

SUM(PP-S1^S2/N(1 )>/SORT((SS< W2)-S1*S1/N( 1 ) ) ( SS ( 2^ 2 ) - S2^S2/N( 1 ) ) ) 

FOR(Sl=SS(!^l) S2=SS(2#1>) 



FRAME 323.00 



G3. ANSWERS. 

1+ PP 

2 SS( 1 # 1)SS(2^ 1 ) 

3 S5( W2) + SS(2#2) 

4 SS( N2)5S(2#2) 






G4 . 

1 F: 



p 

3 



F; 
F ; 
F; 
4 F; 
F; 

- F: 
R: 

- F: 



0:333 

SEPARATELY AND 
OF EACH COLUMN 



THEN MULTIPLIED THE 
SEPARATELY AND THEN 



ACTIONS. 

THAT'S RIGHT. VERY GOOD. 

NO# YOU SUMMED EACH COLUMN 
NO# YOU SUMMED THE SQUARES 
ADDED THE TWO SUMS. 

NO# YOU SUMMED THE SQUARES 

MULTIPLIED THE SUMS. coon- 

NO# I DON'T KNOW HOW YOU GOT THAT. MAYBE IT WAS A TYPING ERR3« 

TRY ONCE MORE. 

NO# THAT ISN'T THE CORRECT ANSWER. 



SUMS 



OF EACH COULMN SEPARATELY AND THEN 






i 






L 



o 

. eric . 

pHgggBEm ' 






30 October 19^7 

(Last page) 

EJCAMPIE C. 3— Student (cont*d) 



■n-i-2914/ioo/oo 



entries 3 ? 

LIST! 

LISTl ( I )=?69 
LISTl (?)s?64 
LISTI (T)3?5S 
LISTl <4)=?39 
LIST1(S)=?6? 

LISTl (6)=?46 
, LISTl ( 7)a?5S 
LIST1,(S)=*?R! 

LISTl (9)=?R1 
LIST?('3) = ?6? 

LISTRC 1 )=?49 
LISTR('?)=?.35 
LIST'?(1)=?47 
LI STR( 4) =?44 
LTSTR(5)=?3R 
, LTSTR(6)=*?46 

LTSTRC 7) = ?39 
LI ST?(S)=?7R 
LI ST? (9) = ? 6 5 

OF PAIR PROO'JCTS =« ? 1 5 1 7 

1«EXECIITI0N OOYIPLETE 



* ENTER CO^MAiNO 
' 7REA0Y 



WHAT ANSWER OID YOU GET? 

♦ ?1 SLT** 

?1 51 7 . 00(^0 

THAT’S ,RIGHT. VERY GOOD. 



ComaentB 



In response to the TEXEClfTE conciiftnd;i TINT re^iuests the entries for LXSTl and 
LIST2* The student type* iii numbers from the i-iLsts and the program computes 
the SUM OP PAIR PRODUC3TS. Having completed the exercise, the student returns 
to the lesson by typing 3RRADY, The lesson then asks for and evaluates the 
student *s answer. This is accomplished by the CALC functions defined by the 
lesson author. in Oroup 4 of Frame 3.27*^' anticipated answers in 

Group 3 of Prams 320.^, which are written in terms of constituent functions. 

It was necessaiy that anticipated answers, for the programming exercises be 
specified as functions* because e,ach student uses different data for each 
exercise. 



Had the student made errors while writing the prog^, the lesson would have 
asked: DO W WAMT YOUR ERRORS. AN^^ED? If the student answered YES, the 

lesson would proceed to. explain the nature and remedy for the errors found by | 
TIKP. However, in this case the student's performance was perfect for the 
exercise. 

End of EXAMPIE G.3 








